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(54) DATA PROCESSING APPARATUS AND DATA PROCESSING METHOD 

(57)Abstract: 

PROBLEM TO BE SOLVED: To provide a watermark system immune to attacks. 



SOLUTION: An encoded data processing apparatus is provided for creating a 
watermarked copy of an original material item by introducing one code word in a set 
of prescribed code words to a copy of a material item. Each of code words in the set 
of code words is intrinsically related to a data word having first and second fields. 
Each of values in a set of values of the first and second fields is represented as a 
first part of a code word having a first plurality of coefficients and a second part of a 
code word having a second plurality of coefficients. By generating the watermark 
code word having the first and second parts, data words in the first and second 
fields are individually identified. The first and second fields are related to different 
parameters such as address parameters, for example. 
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CLAIMS 



[Claim(s)] 
[Claim 1] 

In the coded data processor which generates the copy to which the water mark of 
an original material item was given by introducing one codeword in the group of a 
predetermined codeword into the copy of a material item, 

The codeword generation machine which generates the above-mentioned codeword 
which has two or more codeword multipliers, 



It has the coding processor which combines the above-mentioned jcodeword 
multiplier with the above-mentioned material item, 

It is the coded data processor with which each codeword of the group of the above- 
mentioned codeword is related with the data word which has the 1st and 2nd fields 
by the proper, and each value of the group of the value of these 1 st and 2nd fields is 
expressed as the 2nd part of the above-mentioned codeword which has the 1st part 
of the above-mentioned codeword which has two or more 1st multipliers, and two or 
more 2nd multipliers. 
[Claim 2] 

Each value of the 1 st field of the above is a coded data processor according to 
claim 1 characterized by what is expressed as a cyclic predetermined shift of two or 
more 1st codeword multipliers of the 1st part of the above-mentioned codeword. 
[Claim 3] 

The value of the 1st field of the above is a coded data processor according to claim 
2 characterized by defining the shift with predetermined [ of the codeword multiplier 
of the above 1st / the above-mentioned codeword generation machine is equipped 
with the pseudo-random number generation machine which generates the pseudo- 
random number from which the 1 st part of the above-mentioned codeword is drawn, 
and cyclic ]. 
[Claim 4] 

They are claim 1 which two or more 2nd multipliers of the 2nd part of the above- 
mentioned codeword are drawn from the pseudo-random number generated using 
the auxiliary seed value specified with the value of the 1st field of the above among 
two or more seed values, and is characterized by expressing each value of this 2nd 
field as a shift to which the multiplier of this 2nd plurality corresponds thru/or a 
coded data processor given in 3 any 1 terms. 
[Claim 5] 

The above-mentioned codeword generation machine is claim 1 characterized by 
generating the 1 st seed value for generating two or more above-mentioned 
codeword multipliers from the sample of the above-mentioned material item thru/or 
a coded data processor given in 4 any 1 terms. 
[Claim 6] 

The above-mentioned coding processor is claim 1 characterized by the thing of two 
or more codeword multipliers of the above 1 st, and two or more codeword 
multipliers of the above 2nd for which one of sequence is changed at least thru/or a 
coded data processor given in 5 any 1 terms based on a sequence modification code. 
[Claim 7] 

The discrete cosine transform processor which changes the above-mentioned 
material item into a discrete cosine transform field, 

The material item of the above-mentioned discrete cosine transform field It is 
expressed by two or more discrete cosine multipliers. The above-mentioned coding 
processor By adding one of the above-mentioned codeword multiplier and the 



corresponding discrete cosine transform multipliers By combining the above- 
mentioned codeword multiplier and the above-mentioned material item, and carrying 
out the reverse discrete cosine transform of the image with which the above- 
mentioned codeword was added by this coding processor and by which the discrete 
cosine transform was carried out [ above-mentioned ] A coded data processor 
[ equipped with the reverse discrete cosine transform processor which generates 
the version to which the water mark of the above-mentioned material item was 
given ] according to claim 6 or 7. 
[Claim 8] 

Projection equipment equipped with claim 1 which at least one of an audio signal and 
picture signals is supplied, and introduces a codeword into at least one of this audio 
signal and picture signals before copy processing thru/or a coded data processor 
given in 7 any 1 terms. 
[Claim 9] 

A web server equipped with claim 1 which it is the web server which offers the 
material item downloaded through the Internet, this material item is supplied before 
this material item downloads, and introduces a codeword into this material item 
thru/or a coded data processor given in 7 any 1 terms. 
[Claim 10] 

It is the detection data processor which specifies at least one codeword which 
exists in the version to which the water mark of a material item was given among 
the groups of a codeword. The version to which this water mark was given to each 
sample of two or more samples of the original version of this material item It is 
generated by combining one codeword multiplier to which it corresponds of two or 
more codeword multipliers. Each codeword multiplier It is related with the data word 
which has the 1 st and 2nd fields by the proper. Each value of the group of the value 
of this 1st field It is expressed as the 1st part of the above-mentioned -codeword 
which has two or more 1st multipliers. This 2nd field In the detection data processor 
with which it is expressed as the 2nd part of the above-mentioned codeword which 
has two or more 2nd multipliers, and each value of the 1st field of the above is 
expressed as a cyclic predetermined shift of two or more 1 st codeword multipliers 
of the 1 st part of the above-mentioned codeword, 

The decode processor which reproduces a codeword from the material item to 
which the above-mentioned water mark was given, and generates a playback 
codeword, 

The 1 st part of the above-mentioned playback codeword is made to correlate with 
the 1 st part of each codeword generated from the group of a codeword, and a 
correlation value is computed about each generated codeword. 
The value of the 1 st field is detected from the corresponding correlation value 
exceeding a predetermined threshold, 

It is made to correlate with the 2nd part of each codeword generated from the -group 
of the above-mentioned codeword of the 2nd part of the above-mentioned playback 



codeword, and the 2nd correlation value is computed about each generated 
codeword, 

A detection data processor equipped with the detection processor which detects 
the value of 1 st at least one data field, and the value of 2nd at least one data field 
by detecting the value of the 2nd field from the 2nd corresponding correlation value 
exceeding a predetermined threshold. 
[Claim 11] 

The above-mentioned detection processor, 

The Fourier transform value of the part corresponding to the 1st part of the above- 
mentioned playback codeword is computed, 

The Fourier transform value of two or more 1st codeword multipliers of the 1st part 
of the codeword by which generation was carried out [ above-mentioned ] is 
computed, 

The complex conjugate of either the Fourier transform value of the 1 st part of the 
above-mentioned playback codeword or the Fourier transform value of the 1st part 
of the codeword by which generation was carried out [ above-mentioned ] is 
computed, 

The 1 st middle product sample is computed by carrying out the multiplication of the 
Fourier transform sample of the 1st part of the above-mentioned playback codeword, 
and the Fourier transform sample of the 1st corresponding part of the codeword by 
which generation was carried out [ above-mentioned ], 

The detection data processor according to claim 10 characterized by computing a 
correlation value with the value of the 1st part of each codeword by which carried 
out inverse transformation of the above-mentioned middle product sample, and 
generation was carried out [ above-mentioned ] with the value of the 1st part of the 
above-mentioned playback codeword by computing the correlation sample to which 
each expresses the correlation value of the 1st part of the above-mentioned 
codeword. 
[Claim 12] 

Two or more 2nd multipliers of the 2nd part of the above-mentioned codeword are 
drawn from the pseudo-random number generated using the auxiliary seed value 
specified with the value of the 1st field of the above among two or more seed values, 
and each value of this 2nd field is expressed as a shift to which the multiplier of this 
2nd plurality corresponds, 

The above-mentioned decode processor specifies the auxiliary seed value shown 
from the group of an auxiliary seed value with the value of the 1st field detected 
from the above-mentioned correlation value. 

The above-mentioned detection processor is a detection data processor according 
to claim 10 or 11 characterized by generating two or more codeword multipliers of 
the above 2nd, and specifying the value of the 2nd data field of the above from the 
shift of the codeword multiplier of the above 2nd to the 2nd part of the above- 
mentioned playback codeword from the auxiliary seed value by which specification 



was carried out [ above-mentioned ]. 
[Claim 13] 

The above-mentioned detection processor is a detection data processor according 
to claim 12 characterized by specifying the value of the shift of two or more 2nd 
generated this multipliers to the 2nd part of this playback codeword by making two* 
or more 2nd multipliers by which generation was carried out [ above-mentioned ] 
correlate with the 2nd part of the above-mentioned playback codeword. 
[Claim 14] 

The above-mentioned detection processor, 

The Fourier transform value of the part corresponding to the 2nd part of the above 
is computed. 

The Fourier transform value of two or more 2nd codeword multipliers of the 2nd part 
of the codeword by which generation was carried out [ above-mentioned ] is 
computed, 

The complex conjugate of either the Fourier transform value of the 2nd part of the 
above-mentioned playback codeword or the Fourier transform value of the 2nd part 
of the codeword by which generation was carried out [ above-mentioned ] is 
computed, 

The 2nd middle product sample is computed by carrying out the multiplication of the 
Fourier transform sample of the 2nd part of the above-mentioned playback 
codeword, and the Fourier transform sample of the 2nd corresponding part of the 
codeword by which generation was carried out [ above-mentioned ], 
The detection data processor according to claim 1 3 characterized by making two or 
more 2nd multipliers by which carried out inverse transformation of the above- 
mentioned middle product sample, and generation was carried out [ above- 
mentioned ] by computing the correlation sample to which each expresses the 
correlation value of the 2nd part of the above-mentioned codeword correlate with 
the 2nd part of the above-mentioned playback codeword. 
[Claim 15] 

It is the detection data processor of claim 10 to which either at least is embedded 
to a material based on a sequence modification code, and the above-mentioned 
compound processor is characterized by the thing of the playback codeword 
multiplier of the above 1st and the above 2nd for which one of sequence is returned 
at least based on this sequence modification code thru/or 14 any 1 term publication 
of two or more codeword multipliers of the above 1st, and two or more codeword 
multipliers of the above 2nd. 
[Claim 16] 

They are claim 10 to which either at least is embedded to a material based on a 
sequence modification code, and the above-mentioned detection processor is 
characterized by the thing of the codeword multiplier by which the above 1st and 
the 2nd were generated based on this sequence modification code of two or more 
codeword multipliers of the above 1st, and two or more codeword multipliers of the 



above 2nd for which one of sequence is returned at least thru/or a detection ^ata 
processor given in 14 any 1 terms. 
[Claim 17] 

In the addressee specification system which specifies the addressee of a material 
item, 

Claim 1 which generates the material item to which the water mark was given by 
introducing into a material item the codeword generated from the seed value which 
specifies the above-mentioned addressee as a proper thru/or a coded data 
processor given in 7 any 1 terms, 

An addressee specification system equipped with claim 10 which detects the 
addressee of this material item by predetermined incorrect detection probability by 
detecting the existence of the codeword in the above-mentioned material item 
thru/or a detection data processor given in 1 6 any 1 terms. 
[Claim 18] 

In the coded data art which generates the copy to which the water mark of an 
original material item was given by introducing one codeword in the -group Q f a 
predetermined codeword into the copy of a material item, 

The step which generates the above-mentioned codeword by generating two or 
more codeword multipliers, 

It has the step which combines the above-mentioned codeword multiplier with the 
above-mentioned material item, 

It is the coded data art to which each codeword of the group of the above- 
mentioned codeword is related with the data word which has the 1st and 2nd fields 
by the proper, and each value of the group of the value of these 1st and 2nd fields is 
expressed as the 2nd part of the above-mentioned codeword which has the 1st part 
of the above-mentioned codeword which has two or more 1 st multipliers, and two or 
more 2nd multipliers. 
[Claim 19] 

It is the detection data-processing approach of specifying at least one codeword 
which exists in the version to which the water mark of a material item was given 
among the groups of a codeword. The version to which this water mark was given to 
each sample of two or more samples of the original version of this material item It is 
generated by combining one codeword multiplier to which it corresponds of two or 
more codeword multipliers. Each codeword multiplier It is related with the data word 
which has the 1st and 2nd fields by the proper. Each value of the group of the value 
of this 1st field It is expressed as the 1st part of the above-mentioned codeword 
which has two or more 1 st multipliers. This 2nd field In the detection data- 
processing approach that it is expressed as the 2nd part of the above-mentioned 
codeword which has two or more 2nd multipliers, and each value of the 1st field of 
the above is expressed as a cyclic predetermined shift of two or more 1 st codeword 
multipliers of the 1st part of the above-mentioned codeword, 

The step which reproduces a codeword from the material item*o which the above- 



mentioned water mark was given, and generates a playback codeword, 

The 1 st part of the above-mentioned playback codeword is made to correlate with 

the 1st part of each codeword generated from the group of a codeword, and a 

correlation value is computed about each generated codeword, 

The value of the 1st field is detected from the corresponding correlation value 

exceeding a predetermined threshold, 

It is made to correlate with the 2nd part of each codeword generated from the group 
of the above-mentioned codeword of the 2nd part of the above-mentioned playback 
codeword, and the 2nd correlation value is computed about each -generated 
codeword, 

The detection data processor which has the step which detects the value of 1st at 
least one data field, and the value of 2nd at least one data field by detecting the 
value of the 2nd field from the 2nd corresponding correlation value exceeding a 
predetermined threshold. 
[Claim 20] 

The data signal showing the material item to which the codeword was added by 
claim 1 thru/or the coded data processor given in 7 any 1 terms. 
[Claim 21] 

Data medium with which the data signal according to claim 20 was recorded. 
[Claim 22] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and operates this data 
processor as claim 1 thru/or a coded data processor given in 7 any 1 terms or claim 
10 thru/or a detection data processor given in 16 any 1 terms. 
[Claim 23] 

The computer program which offers the instruction which can be executed by 
computer which it is loaded [ computer ] to a data processor and makes this data 
processor perform an approach according to claim 1 8 or 1 9. 
[Claim 24] 

The computer program product equipped with the medium which can be read by 
computer by which the information signal showing a computer program according to 
claim 22 or 23 is recorded. 
[Claim 25] 

The receiving set which combines with this input signal at least one codeword which 
is the receiving set which receives the signal showing a material item, is equipped 
with claim 1 thru/or a coded data processor given in 7 any 1 terms, and identifies an 
input signal to a proper. 
[Claim 26] 

The detection data processor or coded data processor explained below with 
reference to an attached drawing. 
[Claim 27] 

The creation approach which creates the copy to which at least one water mark of 



the discernment approach of identifying at least one codeword among the 
predetermined codewords explained below with reference to an attached drawing, or 
an original material was given. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] 

This invention relates to the detection data processor which detects the codeword 
embedded at the version of a material. In some examples, a codeword is used in 
order to identify a material item. 
[0002] 

[Description of the Prior Art] 

In order to identify a material, the processing which embeds information to a 

material is called water marking processing. 

[0003] 

A discernment codeword is embedded at the version of a material item, in order to 
identify the version of a material item. That is, the addressee of the specific version 
of a material can be specified by water marking processing. Here, when a material is 
copied or used for the intention of the distribution person of a material in a not 
suitable form, a distribution person can specify the version of a material from a 
discernment codeword, and can take a suitable cure. 
[0004] 

the material item which set on these specifications, and was copied or used for the 
intention of the feeder of a material, an owner, an implementer, or a distribution 
person in the not suitable form — expedient — the OFENDINGU itenrv<offending 
item) of a material, or OFENDINGUMATE — being real (offending material) — it calls. 
[0005] 

Materials may be any of a material (information bearing material) including a video 
material, an audio material, an audio / video material, a software program, a digital 
document, and what kind of information. 
[0006] 

In order to make the structure of a water mark successful, it needs to be difficult for 
a user to remove identification code as much as possible. Moreover, it also needs to 
be difficult for a user to change identification code and to show others the 
implementer of the OFENDINGU item of a material as much as possible. An 
alteration as whose mask of a codeword or codeword by such user shows other 
users is called a KORUJON attack (collusion attack). 



[0007] 

[Problem(s) to be Solved by the Invention] 

It is necessary to make it it become difficult in the structure of all water marks for 
the user who received the copy of the same material to succeed in a KORUJON 
attack. Therefore, the structure of a water mark needs to be what can specify the 
material item to which the water mark set as the object of a KORU JON attack is 
given by the high probability, this specification — OFENDINGUMATE — since real, it 
realizes by identifying the reproduced codeword. The probability (overlooking 
probability: false negative probability) judged as on the other hand a codeword not 
existing in a codeword existing must be low. Furthermore, the probability {incorrect 
detection probability: false positive probability) judge that is the user who performed 
the malfeasance accidentally [ user / who has not participated in a KORUJON 
attack in fact ] must be made as low as possible. 
[0008] 

U.S. Pat. No. 5664018 is indicating the water marking processing which attaches the 
digital water mark created from the codeword which has the multiplier of a 
predetermined number from a material to two or more copies. The material item to 
which a water mark is given is an image. The equipment which performs **** of the 
water mark currently indicated here changes an image into a discrete cosine 
transform <it is called DCT below Discrete Cosine Transform:.) field. A digital water 
mark has normal distribution and consists of groups of a multiplier distributed at 
random. In a DCT field, each codeword multiplier corresponding to each DCT 
multiplier is added, respectively. The detailed mathematical analysis of this water 
marking processing for preventing an attack is indicated by July 27, 1 998 which is 
the reference relevant to this, Jay Kilian (J. Kilian) published from MIT. EFU tea 
Layton (F. T.Leighton) work, and "protection (Resistance of Digital Watermarks to 
Collusion Attacks) of the digital water mark to a KORUJON attack." 
[0009] 

[Means for Solving the Problem] 

The coded data processor concerning this invention generates the copy to which 
the water mark of an original material item was given by introducing one codeword in 
the group of a predetermined codeword into the copy of a material item. A coded 
data processor is equipped with the codeword generation machine which generates 
the codeword which has two or more codeword multipliers, and the coding processor 
which combines a codeword multiplier with a material item. Each codeword of the 
group of a codeword is related with the data word which has the 1st and 2nd fields 
by the proper. Each value of the group of the value of the 1st and 2nd fields is 
expressed as the 2nd part of the codeword which has the 1 st part of the codeword 
which has two or more 1st multipliers, and two or more 2nd multipliers. 
[0010] 

The water mark codeword which has a hierarchical value is generable with this 
invention. By generating the water mark codeword which has the 1st and 2nd parts, 



the data word of the 1st and 2nd fields is discriminable according to an individual. 
The 1st and 2nd fields can be related with different parameters, such as for example, 
an address parameter. For example, the distribution country of a material -can be 
specified by the 1st field, and the domestic specific distribution ground {distribution 
outlet) can be specified by the 2nd field. 
[0011] 

In a suitable example, each value of the 1 st field is expressed as a cyclic 
predetermined shift of two or more 1st codeword multipliers of the 1st part of a 
codeword. In order to realize an effective system actually, the larger possible one of 
the number of codewords discriminable to a proper is good, a distribution to 
consumer appliances, such as video equipment, the projector for movie theaters, etc. 
sake — millions — it is necessary to prepare the group of tens of millions of 
codewords preferably Here, the processing which the group of the codeword which 
consists of 10 million codewords is generated [ processing ], and makes each 
generated codeword and a playback codeword, i.e., the 1 st and 2nd fields, correlate 
serves as a big processing burden. By the example of this invention, the correlation 
value of the codeword of a lot concerning the 1 st part at least can be calculated 
efficiently. By this example, the 1st part generates two or more 1st codeword 
multipliers, and is generated by [ of the codeword in the group of a codeword ] 
computing other codewords by shifting two or more 1st codeword multipliers 
cyclically. [ at least ] Thereby, the correlation value of the 1st part of all the 
codewords in a group is computable using Fourier transform correlator. Fourier 
transform correlator computes the correlation value of a lot by one processing, and 
mitigates an operation task substantially so that it may mention later. 
[0012] 

Two or more 2nd multipliers of the 2nd part of a codeword are drawn from the 
pseudo-random number generated using the auxiliary seed value specified with the 
value of the 1st field among two or more seed values. The auxiliary seed value for 
generating the 2nd part of a codeword may be generated by specifying the relative 
shift of the value of the 1 st field, or two or more 1 st multipliers corresponding to 
this. Each value of the 2nd data field is expressed as a relative shift of two or more 
2nd multipliers. Hierarchical data word can be defined by constituting a water mark 
by the 1 st and 2nd parts. Furthermore, the codeword defined by each data word is 
efficiently detectable using a Fourier transform correlation value while the 
resistance over a KORUJON attack is strong. 
[0013] 

In a suitable example, based on a sequence modification code, even if there are few 
1st and 2nd codeword multipliers, a coding processor changes one of sequence and 
embeds these codeword multipliers to a material. According to this, a data processor 
computes a correlation value in a suitable example by returning the sequence of the 
1 st generated and/or the 2nd codeword multiplier, or the 1 st and/or the 2nd 
codeword multiplier which were reproduced. Although the probability for a 



KORUJON attack to be successful by shifting a codeword cyclically becomes high, 
this probability can be reduced by changing the sequence of a codeword multiplier. 
[0014] 

Furthermore, this invention offers the detection data processor defined as the 
attached claim. In the example of this invention, the value of the 1st and 2nd fields 
is specified from the 1 st and 2nd parts of a water mark so that it may mention later. 
Preferably, this specification is realized by making two or more 1 st multipliers from 
the version of the reproduced codeword, and the 1st part of each codeword of the 
group of a codeword correlate, and calculating a correlation value. This correlation is 
performed by Fourier transform correlator. The value of the 1 st field is specified 
with the correlation value which is generated by Fourier transform correlator and 
which shows the shift of two or more 1st codeword multipliers. The 1st field 
specifies an auxiliary seed value and two or more 2nd codeword multipliers which 
constitutes the 2nd part of a water mark from this auxiliary seed value are 
generated. Here, the 2nd field is again pinpointed from the correlation value which 
shows the shift of the 2nd codeword multiplier using Fourier transform correlator. 
[0015] 

The further side face and the further description of this invention are defined in the 

attached claim. 

[0016] 

[Embodiment of the Invention] 

A general view of a water mark system 

Hereafter, the gestalt of operation of this invention is related to protection of a 
video image, and it explains. The number of copies is determined by the number of 
the users who should distribute a video image. The discernment codeword 
(identification code word) for identifying the copy assigned to one of these users is 
added to each copy. 
[0017] 

A video image is one example of the material protected by embedding a digital 
codeword. The material protected by embedding a codeword may be a material 
including a software program, a digital document, music, an audio signal, and what 
other kinds of information other than a video image. 
[0018] 

Drawing 1 is the block diagram showing the concrete configuration of the coded- 
image processor (encoding image processing apparatus) which introduces a 
discernment codeword into the copy of an original image. The original image I is 
supplied from the source and saved at a frame memory 1. This original image is 
copied as two or more copies to which the water mark was given {reproduce), and 
the discernment codeword of a proper is given to each copy. An original image is 
supplied to the DCT processor 2, and the DCT processor 2 divides an original image 
into the pixel block of 8x8, and performs DCT processing to each pixel block of 8x8. 
Thereby, the DCT processor 2 generates the DCT resolution picture V. 



[0019] 

In the following explanation, the vocabulary a "sample" shall point out the discrete 
sample which constitutes an image (or you may be the material of other classes in 
fact.). A sample may be a brightness sample of the image which can be copied also 
from a pixel. Therefore, vocabulary called a sample and vocabulary called a pixel may 
be exchangeable depending on a situation. 
[0020] 

The DCT image V is supplied to the coding processor {henceforth an encoder) 4. 
The discernment codeword is also supplied to the coding processor 4 from the 
discernment codeword generation machine 8. 
[0021] 

Two or more seed values (seed) are supplied to the discernment codeword 
generation machine 8. Each seed value is used in order to generate one of the 
discernment codewords which correspond, respectively. Each generated 
discernment codeword is embedded to the copy of an original image, and the image 
to which the water mark was given by this is generated. The discernment codeword 
generation machine 8 is equipped with a pseudo-random number generation machine. 
A pseudo-random number generation machine generates the codeword multiplier for 
forming a specific discernment codeword. In a desirable example, a codeword 
multiplier is generated based on normal distribution. In addition, it may replace with 
this and a codeword multiplier may be beforehand defined based on the seed value 
used since a pseudo-random number generation machine is initialized. Therefore, a 
corresponding seed value exists in each discernment codeword, and each seed value 
is memorized by memory 12. That is, in order to generate the discernment codeword 
Xi, the seed value seedi is read from memory 12, and the pseudo-random number 
generation machine in the discernment codeword generation machine 8 is initialized 
using this seed value seedi. 
[0022] 

The DCT version of an original image is expressed in the following explanation as V. 
It is here, 

V={vi}= {v1, v2, v3, v4 vN} 

It comes out, and it is and vi is the DCT multiplier of an image. In other examples, vi 
is the sampled value of an image and may express the sampled value of the image in 
the sampled value of an image in a space field, or other fields. 
[0023] 

Each discernment codeword Xi consists of codeword multipliers of n pieces as 
follows. 

Xi={xij}= {xi1, xi2, xi3, xi4 xin} 

Several n of a codeword multiplier corresponds to the measurement size of the 
original image V. In addition, the number of multipliers may differ and this number 
may be determined according to specific application. 
[0024] 



And the vector of the codeword multiplier which constitutes the i-th discernment 
codeword Xi is supplied to an encoder 4 through a channel 14. An encoder 4 
generates the image Wi to which the water mark was given by adding the 
discernment codeword Xi to Image V. In fact, as shown in the following formulas, the 
image Wi to which the water mark was given is generated by applying each codeword 
multiplier to each multiplier of an image. 
Wi=V+Xi 

Wi=v1+xi1, v2+xi2. v3+xi3, v4+xi4 vn+xin 

As shown in drawing 1 , the image Wi to which the water mark was given is 
outputted by it from this image processing system, after reverse DCT conversion is 
carried out by the reverse DCT processor 1 8 which carries out reverse DCT 
conversion of the image generated by the encoder 4. 
[0025] 

Therefore, as shown in drawing 1 , from an encoder 4, the group of the image to 
which the water mark was given is outputted. If data word is made into a maximum 
of 20 bits, one of the 10 million discernment codewords can be chosen, and the 
version Wi to which 10 million water marks were given can be generated to an 
original image. 
[0026] 

Although the copy Wi to which the water mark of Image I was given is discriminable 
according to an individual with this discernment codeword, in other examples, data 
can be sent within an image by above-mentioned 20 bits. Therefore, 20 bits of 
payloads of 20 bits for sending data within Image V used in order to choose a 
discernment codeword so that it may explain below are offered. 
[0027] 

The coded-image processor which is shown in drawing 1 and which generates the 
image to which the water mark was given is built into various products in various 
different scenarios with which this invention is applied. For example, a coded-image 
processor can be connected to a website or a web server, and the image to which 
the water mark was given can be downloaded. Before downloading the copy of an 
image, the codeword of a proper is introduced into the image to download and the 
codeword of this proper can detect the addressee of the downloaded image behind. 
[0028] 

In other examples of application, a coded-image processor is incorporated as some 
digital projectors (digital cinema projector), and in a movie theater, in case a 
discernment codeword projects a movie, it is added to an image. By this discernment 
codeword, the projector and movie theater which the movie projected can be 
pinpointed. Therefore, the projector and movie theater where the pirate edition copy 
was created can be pinpointed by the discernment codeword contained in the pirate 
edition copy which photoed the image projected from the projector and was obtained. 
On the other hand, the image to which the water mark was given may be copied as a 
photograph or printed matter, and may create and distribute the copy of the copied 



photograph or printed matter. In drawing 1 , the distribution place of the image to 
which the water mark generated by the coded-image processor was given is shown 
by the distribution 1 9 expressed by the cloud-shaped frame. 
[0029] 

Detection processor 

Drawing 2 is the block diagram showing the configuration of the detection image 
processing system (detecting image processing apparatus) which detects one or 
more codewords currently embedded in the OFENDINGU image (offending 
markedimage) to which the water mark was given. Speaking comprehensively, the 
detection image processing system shown in drawing 2 having the function to 
identify one or more codewords which exist in OFENDINGU of an image, i.e., a copy. 
[0030] 

OFENDINGU version W of the image to which the water mark was given is supplied 
from the source of data, and is saved at a frame memory 20. Since the detection 
processing in this detection image processing system needs the original version of 
an image, the original version of an image is saved at the frame memory 24. The 
original version of OFENDINGU version W of the image to which the water mark was 
given, and an image is supplied to the registration processor (registration processor) 
30 through the connection channels 26 and 28 according to individual, respectively. 
[0031] 

As mentioned above, OFENDINGU version W of an image may have been generated 
by photoing or copying some images Wi to which the water mark was given. Then, in 
order to raise the detection ratio of a discernment codeword, the registration 
processor 30 arranges substantially the original version of the OFENDINGU image 
saved at frame memories 20 and 24, respectively, and an image <align). This purpose 
is investigating correspondence relation with the sample of the corresponding image 
Wi with which Sample I and the water mark of an original image are attached, and 
the codeword multiplier's is added. 
[0032] 

This registration processing is explained using drawing 3 . Drawing 3 compares 
OFENDINGU version W of the original image I and the image to which the water 
mark was given, and is shown. As shown in drawing 3 , OFENDINGU version W of 
the image to which the water mark was given has offset to the original image, and 
this offset may originate in the relative visual field of a camera that the OFENDINGU 
version of the image to which the water mark was given was generated.- 
[0033] 

In order to reproduce the expression of a codeword multiplier, it is necessary to 
subtract the right sample of an original image from OFENDINGU version W of the 
image to which the water mark was given. Two images are arranged for this 
processing. As shown in drawing 3 , registered image W" has the boundary region 
(peripheral area) PA which contains in an original image the part not existing. 
[0034] 



By other examples, when an OFENDINGU version downloads, for example from the 
Internet, correspondence relation with the version I of an original image may already 
be in **, and, in such a case, it is not necessary to use the registration processor 30 
with OFENDINGU image W\ Then, this detection image processing system is 
equipped with the alternative-channel 32 for supplying directly the image to which 
the water mark was given to the playback processor 40. 
[0035] 

Registered image W" is supplied to the playback processor 40. The copy of the 
original image I is also supplied to the playback processor 40 through the 2nd 
channel 44. Image W" and the original image I which were registered are changed 
into a DCT field by the DOT processor 46. Next, as shown in the following formulas, 
presumed codeword X' is computed by subtracting sample V of the OCT field of the 
image to which the water mark was given from the sample V of the DCT field of an 

original image. 

gj ID=000003 



Therefore, the playback processor 40 outputs the estimate of the multiplier of the 
codeword which should be identified through the connection channel 50. Reproduced 
codeword X' is supplied to the 1st input terminal of correlator 52. The codeword Xi 
generated with the codeword generation vessel 54 is supplied to the 2nd input 
terminal of correlator 52. The codeword generation machine 54 generates the group 
of all possible codewords using the predetermined seed value which identifies to a 
proper the codeword read from memory 58 like the above-mentioned discernment 
codeword generation machine 8. 
[0036] 

Correlator 52 generates the similar value sim of n pieces <i). In one example, the 
similar value sim (i) is computed by searching for the correlation based on the 
following formulas. 
[0037] 
.Equation 1] 



gj ID=000004 



[0038] 

Each of the similar value sim of n pieces (i) is supplied to a detector 60. and a 
detector 60 analyzes the similar value sim of n possible codewords (i) which is alike, 
respectively and receives. The relation between the example of the similar value sim 
(i) generated by correlator 52 and the threshold TH of each possible codeword is 
shown in drawing 4 . As shown in drawing 4 , two codewords 2001 and 1234S are 
over the threshold TH. For this reason, a detector f>0 judges with the OFENDINGU 
image having been created from the version of the image to which the water mark 
corresponding to a codeword 2001 and a codeword 12345 was given. Therefore, in 
this example, the height of the threshold TH which guarantees incorrect detection 
probability can be set up based on the incorrect detection probability-(false positive 
probability) determined with the magnitude of the population which is 10 million, and 
water mark reinforcement (watermarking strength). By the example shown in drawing 
4 , when the similar value generated by correlator 52 is over the threshold, it has 
this incorrect detection probability, the addressee of the image to which this water 
mark was given performs a malfeasance, and it is judged that it participated in 
creation of the OFENDINGU version Wi of the image to which the water mark was 
given. 
[0039] 

Hereafter, the water mark system feature and advantage which are shown in drawing 

1 and drawing 2 are explained. 

[0040] 

Registration 

The processing which arranges the OFENDINGU version of the image to which the 
water mark was given, and the copy of an original image includes the processing 
which investigates correlation with the sample of an original image, and the sample 
of the image to which the water mark was given. This correlation processing is 
performed by shifting each sample of an image by different shift amount. This 
processing is explained using drawing 5 . Drawing 5 A shows the discrete sample of 
the original image I, and drawing 5 B shows the discrete sample of OFENDINGU 
image W to which the water mark was given. As shown in drawing 5 A and drawing 5 
B, the time difference between each sample is dt which becomes settled with a 
sampling rate. The group of each sample of these images is shifted and the result of 
having made the discrete sample correlating is shown in drawing 5 C. 
[0041] 

As shown in drawing 5 C, the correlation peak is the highest between the 6th sample 
and the 7th sample. Then, to an original image, only this amount is shifted and the 
OFENDINGU image to which the water mark was given is registered. 
[0042] 



Fourier decode 

The water mark system mentioned above with reference to drawing 1 and drawing 2 
can create the version to which 10 million water marks were given to the original 
image. This is realized by using the value of a 20-bit water mark. Here, in order to 
detect existence of the codeword in the OFENDINGU image to which the water 
mark was given among two or more codewords as mentioned above, it is necessary 
to investigate correlation with the codeword reproduced from the image, and each 
10 million possible codeword. Such an operation task serves as a big processing 
burden. 
[0043] 

The correlator based on this invention shortens time amount required in order to 
detect the codeword in the OFENDINGU image to which the burden of this data 
processing was mitigated, therefore the water mark was given. This correlator based 
on this invention is shown in drawing 6 . The correlator shown in drawing 6 offers 
effective technique on the alternative target to calculation of total of the correlation 
value mentioned above. That is, by this example, total of a correlation value is 
computed based on the following formulas. 
F-1[F(X')F(x(1))*] 

Here, F (A) expresses the Fourier transform of A and F-1 (A) expresses the inverse 

Fourier transform of A. 

[0044] 

The correlator 52 shown in drawing 6 is equipped with the 1st Fourier transform 
processor 100 and the 2nd Fourier transform processor 102. The 1st and 2nd 
Fourier transform processors 100 and 102 may be realized using a fast-Fourier- 
transform algorithm. The 2nd Fourier transform processor 102 also computes the 
complex conjugate X1 of the Fourier transform value of the generated codeword. 
The complex conjugate X1 of Fourier transform value X' of a playback codeword and 
the Fourier transform of the generated codeword is supplied to the 1st and 2nd 
input terminals of a multiplier 1 10, respectively. A multiplier 1 10 carries out the 
multiplication of each sample from the Fourier transform processors 100 and 102, 
and supplies this result to the inverse Fourier transform processor 112. From this 
correlator 52, the inverse Fourier transform value of the signal sample by which 
multiplication was carried out is outputted. 
[0045] 

Thus, in the correlator 52 shown in drawing 6 , time amount required in order to 
compute correlation with n codewords Xi and playback codeword X' which were 
generated is shortened. This is because fast-Fourier-transform integrated circuits, 
such as an application-specific integrated circuit"(application specific integrated 
circuit.ASIC) marketed, for example, can constitute the Fourier transform 
processors 100 and 102 and the inverse Fourier transform processor 1 12. 
Furthermore, the inverse Fourier transform value outputted from correlator 52 offers 
the similar value sim of n pieces corresponding to total of the correlation value of n 



pieces (i). Here, in order to use the property of the correlator 52 shown in drawing 6 , 
a codeword is generated by shifting one generated codeword X {1) cyclically using 
the specific seed value supplied to a random-number generation machine. Hereafter, 
generation of this codeword is explained. The 1st codeword X (1) is expressed as 
values x1-xn corresponding to the numeric value generated in pseudo-random with 
the codeword generation vessel 8 so that it may mention later. On the other hand, 
the 2nd codeword X (2) is generated by performing the cyclic shift to the 1st 
codeword X (1). Furthermore, as shown below, other codewords are generated by 
shifting the 1st codeword X (1) cyclically until the n-th codeword is shifted to the 
location of n-1. 
X(1 )=(x1 ,x2,x3,x4...,xn-1 ,xn) 
X(2)=(x2,x3,x4...,xn-1 ,xn,x1 ) 
X(3)=(x3,x4...,xn-1 f xn,x1 f x2) 

X(n)=(xn,x1 ,x2,x3,x4..;,xn-2,xn-1 ) 

The correlator 52 which performs the Fourier transform can compute all the similar 
values about all n codewords by one processing by constituting a part or all of a 
group of a codeword that is generated by the coded-image processor using the 
group of this codeword. Therefore, the total sim of the similar value of n pieces (i) is 
generated by the shift to which it corresponds from 1 to an original codeword to n 
as mentioned above, and as shown in drawing 4 , the total sim of a big similar value 
(i) is generated about at least one codeword. Thus, correlator 52 can receive only 
one generated codeword corresponding to the 1st codeword X (1), and as shown in 
drawing 4 , it can compute the similar value about the group of n codewords. 
[0046] 

If the sample contained in a codeword like [ it is ****** and ] from the above 
explanation is N individual, a possible circular shift is only N individual. Therefore, if 
the population p of a required codeword is larger than N, the water mark used as 
two or more foundations is needed. The water mark used as each foundation is 
shifted cyclically, and the peculiar codeword of N individual is generated. 
[0047] 

When the image to which the water mark was given constitutes one of two or more 
of the images, such as for example, a video sequence, the same codeword-can be 
given to each image. Therefore, as mentioned above, if the codeword under one 
judgment (suspected code word) is specified using the Fourier transform correlator 
shown in drawing 6 , even if it uses the total sim of all correlation values Ki), the 
correlation value which follows is computable. What is necessary is here, to perform 
correlation processing only to the codeword specified by the Fourier transform 
correlator shown in drawing 6 , since the codeword under judgment is already 
specified. 
[0048] 

Moreover, the complex conjugate of the Fourier transform value of a playback 



codeword may be computed instead of computing the complex conjugate of the 
Fourier transform value of the 1st generated codeword X1. This processing is 
expressed as the 2nd modification of processing by the Fourier transform correlator 
shown below. 
F-1[F(X>F(x(1»] 

Thus, either the complex conjugate of the Fourier transform value of a playback 
codeword and the Fourier transform value of the generated codeword are computed 
by either of the Fourier transform processors 100 and 102. 
[0049] 

Secret sequence modification of a codeword 

There is a problem that the security of a water mark falls, by the technique of 
making shift the 1st codeword X1 cyclically, and generating a codeword. This is 
because two images to which the water mark was given are compared in a 
KORUJON attack. When the codeword which are two versions of the same 
codeword which was made to shift the same codeword cyclically and generated it is 
added to each image, those who try a KORUJON attack specify the difference 
between 2 materials to which the water mark was given, therefore it becomes easy 
to specify a codeword. If those who try a KORUJON attack can specify a codeword, 
this person can remove a water mark, or can alter a water mark, and -can pretend to 
be the others. 
10050] 

In order to prevent such a KORUJON attack, by this example, the sequence of each 
codeword multiplier of each codeword shifted cyclically is changed at random based 
on the secret sequence modification code (secret permutation code) pi. A sequence 
change of a codeword multiplier is made secret to the addressee of the image to 
which the water mark was given. It becomes difficult for those who try a KORUJON 
attack to specify by this correlation between two images to which the water mark 
was given, and possibility that a KORUJON attack will be successful falls. 
[0051] 

In a detection image processing system, the secret sequence exchange code pi is 
known. Correlation processing is performed after detection performs reverse-order 
exchange pi- in image-processing equipment to the codeword multiplier or playback 
codeword multiplier which the codeword generation machine or the playback 
processor 40 generated. The detection shown in the coded-image processor and 
drawing 2 which are shown in drawing 1 shows actuation of image-processing 
equipment to drawing 7 and drawing 8 , respectively. 
[0052] 

Generation of a watermark codeword 

Technique to have been improved for generating a water mark codeword is explained 
using drawing 9 and drawing 10 . As mentioned above, the water mark codeword in 
the material item to which the water mark was given is efficiently detectable by 
shifting a codeword cyclically and generating two or more codewords using Fourier 



transform correlator. 
[0053] 

Moreover, when the 1st codeword X1 is shifted cyclically and a codeword is 
generated as mentioned above, there is a problem of becoming easy to receive the 
attack by KORUJON attack. Such possibility can be reduced by changing the 
sequence of a codeword multiplier in secret sequence modification code as 
mentioned above. 
[0054] 

In order to make still lower possibility that a KORUJON attack will be successful, in 
this example, the codeword generation machine 8 which operates as some coded- 
image processors generates the water mark codeword which has two or more parts 
generated according to the individual. A water mark can also be built hierarchical by 
generating the codeword which has two or more parts so that it may mention later. 
Here, a 20-bit codeword is explained in instantiation. A 20-bit codeword offers 10 
million or more (1048576 pieces) codewords as a possible data value. 
[0055] 

A 20-bit codeword is divided into two parts which consist of 10 bits, respectively by 
the example explained here. This is shown in drawing 9 . It is used in order to 
generate the 1st part [ 1st / the ] WM1 of a 10-bit water mark. It is used in order to 
generate the 2nd part [ 2nd / the ] WM2 of a 10-bit water mark. The 1st part WM1 
and 2nd part WM2 are embedded in the image which should attach a water mark, as 
mentioned above. 
[0056] 

In a suitable example, the 1st part WM1 is formed by generating one codeword which 
consists of the 1st codeword multiplier generated with the pseudo-random number 
generation vessel which constitutes some codeword generation machines 8. These 
numeric values are generated from the basic seed value seed, as shown in drawing 
9 . A basic seed value may be generated from the sample of a -source image. 
[0057] 

Each possible data value of 1024 pieces is expressed with the 1st 10-bit part WM1 
of a water mark by 1024 possible shifts obtained by shifting the 1st part WM1 of the 
codeword generated from the basic seed value. As shown in drawing 9 , this shift 
has the possible value of 0 to 1023. 
[0058] 

The 2nd part WM2 of a water mark is generated independently with the 1st part 
WM1 of a water mark. The shift applied to the 1st part WM1 is mapped by one of the 
possible auxiliary seed values (suplementary seeds) of 1024 pieces. That is, i-th shift 
X1 ->i=X1i of a codeword specifies the auxiliary seed value "(seedi) of a proper. From 
this auxiliary seed value, the further codeword shown as X2 in drawing 9 is 
generated. Thus, the relation of a predetermined proper between the seed values 
used in order to generate 2nd codeword X2i the shift of 1st codeword X1i which 
constitutes the 1st part WM1, and for the 2nd partial WM2 is. Here, since 1024 



further possible values are expressed, the 2nd part WM2 of a water mark is shifted 
based on the 10-bit value of the 2nd part WM2. As shown in drawing 10 f the layered 
structure of a value is formed of this processing. The 1st 1024 bit -generated by the 
1st part WM1 offers the index of the codeword which constitutes the 2nd part WM2. 
The possible shift of the codeword generated from the 2nd part WM2 offers a -group 
with a value [ in the 2nd level of a layered structure / 2nd ] of 1024 bits. 
[0059] 

By the example of this invention, the image to which the water mark was given 
based on two or more hierarchies can be specified. For example, since a part of 
country to which the image was distributed, area, or area is specified, the 1st part 
WM1 can be used. On the other hand, since the town and movie theater where the 
image to which it was given, the 2nd part, for example, water mark, of an area, was 
reproduced are pinpointed, a hierarchy's 2nd level can be used. The image to which 
the water mark was given is reproduced by this, it is more quick and the location 
where OFENDINGUKOPI was created from this image ^an be pinpointed more 
correctly. 
[0060] 

The further advantage which generates the codeword which has two parts WM1 and 
WM2 is [ which value of the values of 1024 pieces exists in each of two hierarchy 
level, and ] in the point which can be specified efficiently using the Fourier transform 
correlator shown in drawing 6 . In this combination, since the 2nd part WM2 of a 
water mark is generated from 1024 possible shifts of the 2nd codeword, it can 
specify the possible shift of the 2nd part WM2 of a codeword using the further 
Fourier transform decode. 
[0061] 

The probability for a KORUJON attack to be successful can be reduced by 
generating the water mark codeword which has two related parts. As mentioned 
above, after changing the sequence of either of the parts of these codewords, or 
both, you may also embed in an image. 
[0062] 

Other examples of application 

In addition to the projector and web server which were mentioned above, the coded 
data processor of a water mark system is applicable to other applications. For 
example, this invention can receive a signal from a communication device, and can 
apply it also to the receiver/decoder which gives a water mark to information by 
introducing a codeword into this received signal. For example, a «et top box receives 
television and a video signal from the "head end" device or multicast device of 
broadcast. In such an example of application, a coded data processor constitutes a 
part of set top box, and in case it receives and decodes a signal, it introduces a 
water mark codeword into a video signal. Setting in one example, this water mark 
codeword specifies the set top box which received and decoded the video signal as 
a proper. 



[0063] 

Furthermore, this invention is applicable also to the digital cinema receiver which 
receives digital cinema data (digital cinema film) from a satellite. This digital cinema 
receiver receives the signal showing a digital cinema, decodes this signal, and 
reproduces a digital cinema. This receiver is equipped with the coded data processor 
which introduces a water mark codeword into the decoded movie signal. A water 
mark codeword specifies the digital cinema receiver which received for example, 
digital cinema data as a proper. 
[0064] 

Furthermore, this invention is applicable to a digital camera or a camcorder equipped 
with memory and a memory controller etc. In this example of application, the coded 
data processor concerning this invention introduces the water mark codeword 
memorized by memory into the video signal photoed with the digital camera etc. In 
this example of application, the codeword is beforehand memorized by memory, 
therefore the coded data processor is not equipped with the codeword generation 
machine. The codeword memorized by memory is embedded under control of a 
memory controller at a video signal, and, thereby, specifies a video signal as a false 
proper target (quasi-uniquely) peculiar. 
[0065] 

In the further example, the coded data processor based on this invention embeds a 
series of water mark codewords according to an individual at each of the frame of 
the digital image from which the plurality which constitutes a continuous image or a 
continuous animation differs. These codewords may have relevance mutually and 
can identify now the image corresponding to each frame according to an individual 
by these codewords. 
[0066] 

The further various side faces and descriptions of this invention are defined in the 
attached claim. The gestalt of operation mentioned above can be changed variously, 
without deviating from this claim. 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing the configuration of a coded-image 
processor. 

[Drawing 2] It is the block diagram showing the configuration of a detection image 
processing system. 

[Drawing 3] Drawing 3 A shows an original image, drawing 3 B shows the image to 
which the water mark was given, and drawing 3 C is drawing showing the registered 
image. 

[Drawing 4] It is the graphical representation showing the example of the correlation 
result about each codeword of the group of the codeword of N individual. 
[Drawing 5] Drawing 5 A is a graphical representation corresponding to the sample 
of the original image I, drawing 5 B is a graphical representation corresponding to 
image W to which the water mark was given, and drawing 5 C is the graphical 



representation showing the correlation result for every discrete sample shift of an 
original image and the image to which the water mark was given. 
[Drawing 6] It is the block diagram showing the configuration of the correlator which 
is a part of detection data processor shown in drawing 2 . 

[Drawing 7] It is the flow chart which shows the procedure which creates the image 
to which the water mark was given by the coded-image data processor. 
[Drawing 8] It is the flow chart which shows the processing which specifies a water 
mark from the image to which the water mark which received was given by the 
detection data processor shown in drawing 2 . 

[Drawing 9] It is drawing explaining the processing which generates the codeword 
multiplier which has at least two parts. 

[Drawing 10] It is drawing showing the hierarchical information built using the 
codeword which has two parts generated by the processing shown in drawing 9 . 
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is a part of detection data processor shown in drawing 2 . 
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to which the water mark was given by the coded-image data processor. 
[Drawing 8] It is the flow chart which shows the processing which specifies a water 
mark from the image to which the water mark which received was given by the 
detection data processor shown in drawing 2 . 
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multiplier which has at least two parts. 
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codeword which has two parts generated by the processing shown in drawing 9 . 
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&®.<DMl¥$:&m?Z>Z\i:\Z&K) , Zl©Sg^£<g$-r5£<»:a*T-#-2>„ 
[0014] 

9 fc. #893© Jtr#0JKi5^T«, 7 * - * -7- ©Sg 1 RtfSfl 2 <Z)gB#^ S Sg 

iatf«2©7>f-^Kott^#st5, »*l<«, £ © « , n £ £ n 3 - k 7 

-K©A-:x3>a><S©$f5l©1g!5Sc©^&£:, 3-F7-H«DtO#a-l«7-Kc!)*i 
©g|5:9-<h£fflllS£i*Tffl§B«£*#5££K,fc9ll3i£n-5 < , £©*§««, 7 - U X £ « 

. JB 1 O * |fc O 3 - K «7 - F « » © -> 7 h t S r « M « K * ^) T * n * . ^107^ 
-;H«B, 1iS)M->-Hfii&#3£L, £©^SaM->-Kffi*><b7:i--:5'-7-7©SfS2©gB 

a* w it s n * . 

[0015] 

# © s & Ad ® & # # sua , ^#©w*wigH»ci3^T^e$nT^^„ 

[0016] 
[5293©IS*6©J§?t8] 

'J^-^V-i'yXfACSI 20 

T^€r3--y*©8H:: < i;9 3br-©gc#*fe$£-r-2>. # 3 fcf - tc te , dn<E>©3.--tf©5*.© 
lAl::#J9^Te.nfc3bf-€:^#JT5fc#©^Sij3-K7-K (i dent i f i c a 
tion code word) *!#HSH5. 
[0017] 

Vr*Wm\Z. =r V 9 )V 3 - K 7 — K£S*&tr;i<h»::«fc9«S£n.5-77 i 'J7;l'© — ft 

miZ. V7h7i77P^7A, f yi'^Xt. # & . * — 5 s * ft # ttKD^fttzZ 

[0018] 30 
Blli, * U 5?7-;HH«©3 If -K II SI 3 - H >7- H Sr^A-f S ft ii! * ffl S « B (e 
ncoding image processing apparatus) © ft # &9 #| 
^Sit7Dy7@TS5. * U ± )Vm m I « , y-^jJ»6«»Sft. 7l/-i^t'J 
i i:«#$n5. :<D*'jyt^Ittt. 7*-*v-?at#<*n*: « » © 3 -tf - <t l t 
|?S*15 (reproduce) *> © T & D . # 3 fcf - IC « , @ *T © ^ gij 3 — K 7 - h* 

*i # $ ft z> . t'jytjuiii, DCT7ot7it2 i:itsn, d c t 7° a ^ u- 2 « 

, ^-Uv^-;UiB«tSr8x8©iii^7D-y^(CiriRlL, 8X8©&iSil?7'ti>;/7J;:DCT$a 
SSrJST. dtllCtD, DCT7"Dt!/*2tt, D C ^®«V*4fiEf5. 
[0019] 

£i.T©tsi^{c*3^T, r-y-^T'^j t.^ ? mm\$. mm <x»a. msta<is«iS(Z)v t- 40 
u 7 ^ t * o t t> «k v> . ) Sr#i^-rsiiitJ[ir>y)w^^-rfe©<i:-rs. u- > 7 0 , mm 

ft e. fegft -5 d t^T # & ® © » S > 7" * ^ T t> ±H . LfcAioT, 1r > 7* ^ 
t^pfflBtlSiSit^^fflBte, #i5U::ckoT«3£& "BT-tE T * * « ^ ■*> * * . 
[ 0 0 2 0 ] 

DCT1«VIJ, ft *tfc 7" a -fe If- ( J£A T , x>3-^ifc^'5 <) ) 4 K # «& $ *1 •& . f? 
*t 7* P -fe * 4 \Z tt , SS SU 3 - h' 7- K4^S8^6W9J3 - K 7- H*««3nTH 
•5 . 
[ 0 0 2 1 ] 

R g'J 3 - H 7 - K £ fifc 8§ 8 IZ tt . « » © -> - H fit (seed) *»«HSn5. &y-Ki 

tt . ^-n-€ r nM«-r*^S'j3-H7-K©lt?Sr^^-r^)fcJ6JCl£fflSn^o 50 
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& m. g'J 3 - h «7 - v tt , *u^^-;uB«<03tr-»ca«>a*n. mcio^t-^v- 

. S<HSLSfe£j*88tt, »SC«SI3- H7-H€»*t4fc»03- K9-f«»*4)« 
■T*. lfiU>IH(:«i:tHTIi ( 3- K 7- I* «»«, iEjS»*t«^l-»t*rt«ns 
. fciJ. ^niCfliAT. n — H 7 - HIStt, *«SL * £ »*» IB » <fe T fc'fc * ffl V» S 
-> - H tt 13 * 3? H T , * i* a6 T <t v> „ L a* o T , §iffl 3 - H 7 - H fc<4, *f Jfc T 
S > - H fit # SE L . & -> - K m tt . / t'J 1 2fcE*SnTV>5. T & £ , » 9J 3 - 
P7-FX i££f£-r3fci?>l3, y-Hffls e e d 1 * * * U 1 2 £ g£ * til L , £ © -> 
-h'lseediSlUT, l»3-F7-l«i*»8 AOf fl&«idlf ««»ftt3 

10 

[ 0 0 2 2 ] 

V, T <D tt m T , * l Jyt;H«©DCTA*-y 3 >JViSt. d H "C, 
V = { v i } = { v 1 , v2, v 3 , v4, vN) 

vi«, I«ODCT^ST$5. flfi © Hr # 0U3 & ^ T tt , vi«, iB«t<7>-y-> 

[ 0 0 2 3 ] 

§WJ3-H7rHx i tt , SAT © «fc p , nfllCDn — K "7 — K fli & 6 USJitlTH* 

Xi = lx i ] ) = (x i 1, x i 2, x i 3, x i 4, • • • , x i n } 20 
3-b--7-h*&&©gcntt, * i) Vi- )VWmv (DD- > 7 Jl&HZttfe-t 2> . frfc, <D « 

[ 0 0 2 4 ] 

L T , i # S © St gi] 3 - f* «7 - h* X i SifiEt 5 3 - F 7 - H fil » © ^ * b )V tt . * 
>*iH45:^LTX>3-y4l:«^Sn-5. I>3-^4tt, j® # V K gij n — H7 
- V X I & til? * Z. £ \Z & Q , 7*-^v-^*t#$nfclii«Wi.&^^-r-2.. UBS t3 
tt, J^T©^{c^-r«t-5tr, Wfo<D&&&\z&3- F<7- \*&&&lKiZ.2>z\iiizJir) ^ 7 

W i = V + X i 30 

W i = v 1 + x i 1 , v 2 + x i 2 , v3+xi3, v4 + xi4, • • • , vn + xi 

n 

m l iz^-T J: -5 (3 , *s#$nfciiw i tt, x > :n - y 4 ic £ D £ s£ £ tt 

fcili^Sra&DCT^gl-r-SiSSDCT^Pir^-y-l 8l:i^T, mDCT&m£tl1t'&. Z\ 

[ 0 0 2 5 ] 

L fc ^ -2 T , 0 1 titi^l:, x > zi — ^4A^li, *j * — ^ v - 2 $ ttfc Bi#<D 
Sfl # [ii 73< £ tt S . ?-^7-I**i*2 Oty htt4i, -f SI ©SISJn - F 7- H 
oio^lKtSitjiiTf , * 'J vtJUf i:JtLT, - ^ 7j fB co 7 * - * v - *t# 
5nfcA-y3>Wi54fiET5;t)iitf5. 40 
[ 0 0 2 6 ] 

3; cr> ^ gij =i - K -7 - h* 13 <fc 0, Hi«!l©7*-^v-i7*s#$nfc3tf-WiSr IS g'J 13 ffi, 
JiJtS^ t^TfS^, fft CD ft # 0H3 *> U T tt , ±i©2 0 htiD, illrtrf- 

^SrSlSCliidtT^^,, L o T , WT(3tt^-r-5J;3{3. ISi S'J 31 - K "7 - h* £ S f 
■5fcJ6t3ffiffl^n^2 0 tf y htt > Bi & V F»g T ^ — ^ £ j£ £ Ac £ CO 2 Otf-y KO^-fD- 

[ 0 0 2 7 ] 

eiitc^-r. a*-^v-i7*t#$n^iii«ii.&^fi£-rs^^^®««!isgstt, * g h #< 
® m s n & « * & s & -s. ~> i- u * 13 * n t . * * & » s «c m. & s n -s . #j tt . nmt 

M^MS^B^^xy-y-f FXtt7xy , D--A , i:a^LT, -7 * - * V - $ tt H 50 
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h* £ n -s is «t if « m m <d a - h 9 - k *t m a $ n , z. <d h © 3 - h 7 - h \z £ 0 . y ? 

>D-l«3ftfcli(D5l«*«i:*Bti:ti«T*5. 
[ 0 0 2 8 ] 

f& CD 3§ ffl 0J T , ^-^IbHilfe^S^Mti, * JUi* ^ 18 (d i g i t a 1 c i n « m 

a p r o j e c t o r) © — eCtlxTm^-iiSn, » 9J 3 — f* "7 - K tt , M A ^ 13] €g 
43 ^ T , n*Bi£i!*^-r£B5l;:, iifc&Kttaosns. ^ © SI 8'J 3 - K 7 - H \z ± D , ® 
**B!*i^^n^:IBte^«KStXl!!*iiBigg«r4#3e-r^. ^«ti3&«-T?#^. Lfci^t, Vk W Wi *> & 2f 2 

# ft $ *l fc Hi ft , ?XXIiEPMfttLTl?3nt 1 bck<, ffi^ $ XXteWB'J'fe 

con tf-i&f^fiK&t/gB^LTfccfcii. Bic^^Tii, nmtmmmm&m\z ^ x ^.^l 
ztizo *-?-?-?tfttt<fttzwm<z>mmft\t. s ^ co # s s n *l is « 1 9t*s 

[ 0 0 2 9 ] 
& a ^ P -fe y it 

0 2 « , ^*-i'V-^!jt#snfct7i>'f^ >yB« (o f fend i n g ma r 
ked image) rtl:i*atnT^5 1 o£t±©3 - F^-KSrtfcffiT'Si&liiiljftffl 
(detecting image processing apparatus 

) ©i***ryDy^HT*5. 0 2 t^-r^aiiii^iiaasBii. ® .20 

««7)^-7x>7 i i' > £>\ T & to "5 3 fcf-ftJC^ft-r* l O « Jt CD 3 - K «7 - K £ £S #J T 
[ 0 0 3 0 ] 

7 1/-a> ; e'j 2 oicfissns. z. (D^mm^mmmmiz ^^mmmu. w 

*0*'J?t*/t-J'3>t*«itSfcl6. 7 - A * ^ 'J 2 4 K « , Hi ft <D ^ "J 5> 

->* 3 > W ai/ISffltUyt^A-xaXi. * tl tl f@ SU CD & fig * > * ^ 2 6 , 2 
8S^l/T, £ fifc n -fe y It (registration processor) 3 0 1: 

«^sns. 30 

[ 0 0 3 1 ] 

Ji i£ cd £ 5 K , Bft0^-7x>7 i >f> : y/N*-v3>W' tt , 7*-^v-^7ii#$nfciii 
K>7-h*©^ra^SriS4i>^fe«){C, SST'nty^S 0«, tl *t7l/-A/tU 2 0 

, 2 4 i:ffi#$nxt^t7i>r^ > ^isft <t HftcD * u v -r )v n - v> b >.i*$gs5 

l:ti!A5 (align) . IffllWIi. U ->* :t ;P ili ft CD it > y I i: , 7 * — 9^ — 9 

# £ *i , 3 - H7 - h*^&ai#;trasnT^3*fj£;-r£iiiftw i ©tf>7';Ki:C9^^i.# 

[ 0 0 3 2 ] 

COfgj8ISE3SfflHtMt*. 12 3 \t, tiJ-7t^i«Ii7*-?-7-i/A!# 40 
$nfe^i^ftw^-7x>•7 ; -1'>^/^*-> J 3>W , tkULTSLT^^. 03(:*ti5 
Id , 9*-^v-i?jit^^nitIt©t7x>T-f ^i^A-ya >W fcfc , ■* zt-T )Vm 
il:MLTt7t? bStLTl5 0> u©* 7t 7 MS. 9 * - ^ 7 - J; 

cd * 7 x > > 9 n — v * titzx * y (DmMWtt&mizmmT z> wm 

[ 0 0 3 3 ] 

n - h'7 - F m&<D &m Z> ft tb\z . ^tf-^v-^^tt^nfciSftcDtf-^x^ 

>c > y a* - a > w <=> * u v> ± )v m ft cd m l ^ it > ji £ as n t z & s a< $> z> . z.e> 

& S CD tc * tC . 20©jSft*««JA^n-5,, 03l:^ti^lC, S @ £ *1 tc H ft W" {J, * 

U v -y )V m ft «C « # ffi L t«c b» 8(5 5t to A 21 ffi « (per i p h e r a 1 area) P 50 
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[ 0 0 3 4 ] 

<d m m t \t , en * « -r > * - * ? h *» a * y x > x > y a* - ->* 3 > a* ^ ^ > a - f 

£ ft it « £ , *7i>f^ >^itW <h gE tC :* U ^ ^ ^ H <fc CD A* - ^ a > I £ CD ft j£ 
gC & ?5< m to T S> * £ t & 0 , Z. <D <k 5 & m , S & :/ n -fe y U" 3 0 -£ <£ ffl T -5 & S (2 & 

[ 0 0 3 5 ] 

iSSftfcllW" 12 , B*7 p D-k'ytf4 0lc«j^sn-S). Bi^at yit 4 o W, 
2<D^\>*.)V4 4*-frl,T. * U y'tMt I OP tr - & *S $ ft 5 . g&3ftfcBIi#t 10 
W " & * U Jit ■ • I 12 . DCT^Dt7l)-46l:ioT, D C T(g«l:f jlSftS 
. ^tr, T CD jUc T «k .5 1C , t U ytMiroDCTftOt^^^Vd^^*-^ 

- tfttz ntzwrnoD c t m&w > y° )iv ' tsctckt), « £ n - f 9 
-fx' a* # m 3 ft 5 . 
X* =V* -V 

= v* 1-vl, v* 2-v2, v* 3-v3, v' 4-v4, • • v 
' n-vn 

= x* 1, x* 2, x* 3, x* 4, • • x' n 20 

U # o T , »£7o-fey-tf-4 0 12. «i^5 i ^>^^5 0.€r^LT, SiSiJ-r^€n-K'7 
-FcD^ftCD«i?£(iI£ffi?J-r-5>. B4$*lfc3-F7-HX' (2. !SII8g35 2CDSeiCDA 
TjSffi^lwiftiiiSSftS. tBg€gg5 2<D^20A*ffl^tCl2, 3 - F7- FtSS 5 4 tj;^ 
T4)S*nfca-K9-FX iAiftfeSnt^S. 3 - K 7 - H4«S5 4 B, i: izB <Z> IS 
gij 3 - F -7 - F £ fiK §§ 8 i: 1^ m \z , ;* 'J 5 8 S « * Hi L 3 - 1* "7 - F *« *T « »J 
f 5 f?r 5E CD -> - F(l£ffi^T±T©pJ|ig&3- F "7 - FCDii<&££(ijtT£. 
[ 0 0 3 6 ] 

*8 gfl 5 2 12 . n fl 0 flt tt s im (i) £ £ J$ "T £ . - ft # fll 1C *3 V> T tt , SiflUfits i 
m (i) 12. ^T<D^lC«^<ffilIS£#*£C:<hl;:.fc9*Hi£ft-5. 

[ 0 0 3 7 ] 30 

[ft 1 ] 

X l *X' JC , l*JC , l+JC i 2*JC , 2 +JC , 3*^+...+^/»*^. 

sim(i)= = =- 

[ 0 0 3 8 ] 

n a ® « « « s im (i> cd ft ft 12 , tms6 o ctttssns. ^lt, & m §g e o 

12, n dtfjpjffitea- F -7- F CD ft ft IC *t f 5 « (BUI s lm (1) S»*ft«. fill 40 
g5 2l:,t?T4filc3n5Sffilis im (i) 5)|#Wi. f£ ft & 3 - F -7 - F CD Blffi 
THtOffii^04l:f t. 0 4 1;: T <fc 5 Id , 2 7©3 - F7 - F 2 O O 1 , 1234 
5 AJMiTH5rgAT^5. C CD £ , & Hi g§ 6 0 t2 , 3 - F "7 - F 2 0 0 1 3 - F 
■7 — F 1 2 3 4 5 C»>£:t5 1 7t-5'7-7^ftSnfcI«©/\ , --7 3 >^e,^7i>f 

«*lC*#*lCJ:Dft)eSft6«*Ut* (false positive prob 
abi 1 i ty) £ . "7 * — ^ V — 3& (watermarking s trengt 
h) tltS^'^T. ^Mffifil^Sr^lI-rsraffiTHCDJiS^Sr^^-r^Clt 04 
1C T ft # #J T12 , ffiSS5 2l:«k9T*fi£$nfcIii^HI§g^TU5i^, Z <D 
fgH&tnffl|2££ fc o T , d CD -7 * - * V- ? 3 *i IB «t CD £ (I * # * IE ft & £ rr t» . -7 50 
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* - s> - t> W z tx tzw m. <d -t y x. > 4 > tf b > w i <d ft fig iz m % v fz <t m m 
jus. 

[ 0 0 3 9 ] 
[ 0 0 4 0 ] 

§e 

-tSrftjA^fiasti. * u ^- ;u a <t <z> -y- > y ;i, t , c*-^T-i7*j#snfci®«©-y- 
iT->7 hstxiff ^ns. zwmw&w s & m^xmw? z> . is a», tuft* 10 

m W* <E>&i«f+J->7 p ;l<£^LTl>&„ 0 5 ASi;i5Bl:ifJ:ol:, & D- > y° )l< ffl (D 9$ 
[ 0 0 4 1 ] 

[ 0 0 4 2 ] 

7-Ulfi§ 20 
El 1 RZfm 2 Sr#^LT±j$Lfc^^--^T-i7 -> X ^ A « , * 'J xt;H*i:»lT- 

©3-F7-F©^, — ^V-^7it#$nfc:i-7x>^^ > ?mm[H<D i — K >7 — 

K<a#£E£&ffi-f£fc<*{::te> t ©i« 14 S nt 3 - K 7 - H i , - =F 7J <B CD pTffi 

£ & £ . 
[ 0 0 4 3 ] 

*^^tcS-^<ffiW38«, d©igSt^S©ftS*6mb, bfe*^T^*-^v-^*i^ 
$n&t7i>f >^H«rtron - H>7 - K £ & m T 5 # »c # g & B# *S IS T -5 ., 30 

F - 1 [ F CX • ) F (x ( 1 ) ) * ] 

- - T > F (A) ttA©7-'JXf iSgL, F-l (A) \t A <D j£ y - 'J X ^ & £ « T 

o 

[ 0 0 4 4 ] 

^DtylH02t*IAi. SlSl):i2C7-'Jlfi7'ntytl 0 0, 1 O 2 *«fc 

d-i 0 2B, £f&znrz3— \*v-\*<Dy — v3L%;i&w.<D&m#i'&xi*>miii-rz> < , gt 

a - K7- h-©7-'Jl^«tX' £ > t«$nfc3-F7-H07-UfSOSI* 

«: x i \t , ^n^nsisi 1 o ©sg 1 sr/m 2 <d a # ss§ ^ tc « 3 n 5 . *»§gi 1 0 
« , 7 — >jx*«^D-ty9-ioo. 1 0 2*>e 1 ©&^>7'ji/.$*»L 1 ;:«>*&** je 7 
-ijx^«^a-fe>>-y-ii2tcttJii&-r-5. ;©«ws5 2 mwzti ftm ^v>y 

;KDiS*7-Ux£&<ga*ttj#$n5. 

[ 0 0 4 5 ] 

F7-KX' t©ffiM€r»W-r^fc«6tC^S^I^fB]75^ai^n^. £ tlte . 7 - U X ^ & 
y°n-tyVl 0 0, 1 0 2 R^f 7-iJlE87'Ot7iJ-l 1 2^^A«rUBg^nT^-5 50 
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# 5£ m j& ft * g& (application specific i n t -e g r a t 
ed c i reui t :ASIC) *©Hi7-'Ji|{ii « Cel & 13 * K> 18 fi£ "C £ -5 fc «6 
T £ 5 . 35 t3 . ffl BTgf 5 2^e,{iS7j£n£i£7-Ux^g|fItf, n <@ CO ffi « fit © ijig ft! (3 *t 
)S;-rSn<@©3S^<ls im (i) 5Sftt5. d 13 "C . SI6<r*TfflM8s52<0^«^jpJ 
fflf-£fctf>l3, 3i-F7-Ftt, S5LR4J«»k:«ie* n*»*0D P«ftffl^T, £fi£ 
Stlfc 1 - f«7 - h'X (1) Sr«SW«c->7h-r^»Cl<!:trJ:D*fi£$n-2>. 

I©3 - K7 - K04^l;9HTlft5. iitSi^l:, Sl(Oa-C7-FX (1 
) tf , □ - F 7 - H * 8 13 «fc o T 9 > 9 A W 13 £ J* 2 ft £ % fig tC ttfc? Z fit x 1 
-xntLT^SnS. -7j , »2©3-H7-h , X (2) tf , I1C3-F7-HX ( 
1) C»t5«»W>'7 K6*fit4u tl:J:!J4)«sn«. II:, « T 13 f «fc 5 13 , 10 
CCD*03-K7-HI4, n§|03-F7-Htfn - 1 CD & B «3 -> 7 h * n * * ^ v ffS 
103-H7-HX (1) £«I»l;->7 htSIiCiOtS^n*. 
X (1) = ( x 1 , x2, x3, x4. . . , xn — 1, xn) 
X (2) = (x2, x3, x4. . . , xn-1, xn, xl) 
X (3) = (x3. x4. . . , x n — 1 , xn, xl, x2) 

X (n) = (xn, xl, x 2 , x 3 , x4. . . , xn — 2, xn — 1) 

z. <d 3i - f .7 - KcasffluT. n # it m # 7 p -t v v \z & t £ j& $ n 5 n - f 7 - f 

CO Sll CD - SB X £ SB £ #f fifc T 5 C £ (3 J; 0 . 7- U Xg&£fr 5 ffi Wig 5 2 te, — EIC® 
ST n m<D±T CD a - F 7 - K 13 BUT 5 £T <D « £ » ttl T -5 :i *<T# -5.. Lfcii'o 20 
T, ± j£ CD «fc 5 (3 , *U-7t;i'©3-H7-Ht:Mt5 l*^nST©»^t5x7 M: 
«fc 9 , nflKDgiiEifiScDiiigifOs im (i) # £ fi£ 3 ft , 0 4 1:^^^51:. ^iKifcl'S 
CO D - F 7 — HICOD.T, ±% tzm®m<Dl&*l s im (i) # £ fi£ $ *1 5 . 3. CD «fc 5 »3 , 
«il»5 2tt. I10O3-K7-KX (1) K#j£T5 10CD£/£;*ft;tzi-F7-F<D 
^ £ g Bi o T , 04fC^-r«fcPlCn<H©n-h'7-h-<75ijia(CBI|-r-5S<K{iSr#tt}-ri.z: 
£ ri* T # -5 . 
[ 0 0 4 6 ] 

a ± co ttt e> « & «t -5 ic , 3 - H7 - f ^ * ft -s tr > 7 ;w a* n is t & n tf . pj-tg tf. 

if ->7 MaN<iCD*T&5. L£:;ft*-3T, & g & 3 - F 7 - h' OS«i p *«N <t 0 

tf *l tf, «&coa®<hte57*-:*x'-£at ! &g<hft5. S-Sfili^S^^-^V-i/ti 30 

[ 0 0 4 7 ] 

v * - ? - ? wtt a fttzwmtf . m z. a v 7 * *s - >r > * m v> m & e> m m <d 1 ost«se 

"T a « £ , ^SfclctfrnUn-K^-Ffctt-rct^T^-S.. IfciihT, @6l:st7 
— 'Jx^^ffiM^Srffl^T. 1 tJOWt+ca- ( s u s p-e c t *-<l cod 

e word) A^t^tlS t. ±TCDt§MteCD*g?as im (i) £ ffl 

T t> , ?*!^-rSffiffi<iS:S:tn-r^^<i:*iT#-5. HT, *IJ-5E + CD a - F 7 - F tf U<3 # 
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1 Title of Invention 

n ATA PROCESSING APPARATUS A ND METHOD 

2 Claims 

1. An encoding data processing apparatus for generating at least one 
marked copy of an original item of material by introducing one of a predetermined set 
of code words into a copy of said material item, said apparatus comprising, 

a code word generator operable to provide said code word having a plurality of 
code word coefficients, and 

an encoding processor operable to combine the code word coefficients with 

said material, wherein 

each of said plurality of code words of said set is uniquely associated with a 
data word having first and second fields, each of a set of values of said first field being 
represented as a first part of said code word having a first plurality of coefficients, and 
said second field is represented as a second part of said code word having a second 
plurality of coefficients. 

2. An encoding data processing apparatus as claimed in Claim 1, wherein 
each value of said first field is represented as a predetermined cyclic shift of said first 
plurality of code word coefficients of said first part of said code word. 

3. An encoding data processing apparatus as claimed in Claim 2, wherein 
said code word generator includes a pseudo-random number generator operable to 
generate pseudo-random numbers from which said first part of said code word is 
derived, said value of the first field defining a predetermined cyclic shift of said first 
code word coefficients. 

4. An encoding data processing apparatus as claimed in Claims 1, 2 or 3, 
wherein said second plurality of coefficients of said second part of said code word are 
derived from pseudo-random numbers generated using one of a plurality of 
supplementary seeds identified by said value of said first field, each of the values of 
said second data field being represented as a corresponding shift of said second 
plurality of coefficients. 
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5. An encoding data processing apparatus as claimed in any preceding 
Claim, wherein said code word generator is operable to generate a first -seed value ^or 
generating said first plurality of code word coefficients from samples of said material 
item. 

6. An encoding processor as claimed in any preceding Claim, wherein said 
encoding processor is operable to permute at least one of said first plurality of code 
word coefficients and said second plurality of code word coefficients in accordance 
with a permutation code. 

7. An encoding data processing apparatus as claimed in any preceding 
Claim, comprising 

a discrete cosine transform processor operable to transform said material item 
into the discrete cosine transform domain, said material item in said discrete cosine 
transform domain being represented as a plurality of discrete cosine transform 
coefficients, wherein said encoding processor is operable to combine said code word 
with said material item by adding each of said first and second code word coefficients 
to a corresponding one of said discrete cosine transform coefficients, and 

an inverse discrete cosine transform processor operable to form said marked 
copy of said material item by performing an inverse discrete cosine transform on said 
discrete cosine transformed image to which said code word has been added by said 
encoding processor. 

8. A cinema projector including an encoding data processing apparatus 
according to any of Claims 1 to 7, wherein said data processing apparatus is operable 
to receive at least one of audio signals and image signals before reproduction, and to 
introduce a code word into said at least one of audio signals and image signals before 
reproduction. 

9. A web server operable to provide material items for downloading via 
the Internet, said web server including an encoding data processing apparatus 
according to any of Claims 1 to 7, wherein said data processing apparatus is operable 
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to receive material items and to introduce a code word into said material items before 
said material items are downloaded. 

10. A detecting data processing apparatus operable to identify at least one 
of set of code words present in a marked version of a material item, said marked 
version having been formed by combining each of a plurality of samples of an original 
version of said material item with one of a corresponding plurality of code word 
coefficients, each code word being uniquely associated with a data word having first 
and second fields, each of a set of values of said first field being represented as a first 
part of said code word having a first plurality of coefficients, and said second field 
being represented as a second part of said code word having a second plurality of 
coefficients, and each value of said first field being represented as a predetermined 
cyclic shift of said first plurality of code word coefficients of said first part of said 
code word, said detecting data processing apparatus comprising 

a decoding processor operable to generate a recovered code word from said 

marked material item, and 

a detection processor operable to detect at least one first data field value and at 

least one second data field value by 

correlating the first part of the recovered code word with a first part of each 
regenerated code word from the set of code words to generate a correlation value for 
each regenerated code word, 

detecting the value of the first field value from a corresponding correlation 
value exceeding a predetermined threshold, 

correlating the second part of the recovered code word with a second part of 
each regenerated code word from the set of code words to generate a second 
correlation value for each regenerated code word, and 

detecting the value of the second field value from a corresponding second 
correlation value exceeding a predetermined threshold. 



11. A detecting data processing apparatus as claimed in Claim 10, wherein 
said detection processor is operable to form said correlation value for said first part of 
said recovered code word and the first part of each of said regenerated code words by 
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forming a Fourier transform of a part corresponding to the first part of said 

recovered code word, 

forming a Fourier transform of said first plurality of code word coefficients of 

the first part of the regenerated code word, 

forming the complex conjugate of one of the Fourier transform of the first part 
of the recovered code word and the Fourier transform of the first part of the 

regenerated code word, 

forming intermediate product samples by multiplying each of said Fourier 
transform samples of said first part of said recovered code word and the corresponding 
Fourier transform samples of said first part of said regenerated code word, and 

forming correlation samples for the first part of the recovered code word by 
forming an inverse transform of said intermediate product samples, each of said 
correlation value samples providing the correlation value for the first part of said code 
words. 

12. A detecting data processing apparatus as claimed in Claim 10 or 11, 
wherein said second plurality of coefficients of said second part of said code word are 
derived from pseudo-random numbers generated from one of a plurality of 
supplementary seeds identified by said value of said first field, each of the values of 
said second data field being represented as a corresponding shift of said second 
plurality of coefficients, wherein 

said decoding processor is operable to identify a supplementary seed from the 
set of supplementary seeds, indicated from said first field value detected from said 
correlation values, and 

said detection processor is operable to regenerate said second plurality of code 
word coefficients from said identified supplementary seed and to identify the value of 
said second data field from a shift of said second code word coefficients with respect 
to said second part of said recovered code word. 

13. A detecting data processing apparatus as claimed in Claim 12, wherein 
said detection processor is operable to identify the value of the shift of said 
regenerated second plurality of coefficients with respect to said second part of said 
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recovered code word by correlating said regenerated second plurality of coefficients 
with said second part of said recovered code word. 

14. A detecting data processing apparatus as claimed in Claim 13, wherein 
said detection processor is operable to correlate said regenerated second plurality of 
coefficients with said second part of said recovered code word by 

forming a Fourier transform of the second part of said recovered code word, 

forming a Fourier transform of said second plurality of code word coefficients 
of the second part of the regenerated code word, 

forming the complex conjugate of one of the Fourier transform of the second 
part of the recovered code word and the Fourier transform of the second pan of 
regenerated code word, 

forming intermediate product samples by multiplying each of said Fourier 
transform samples of said second part of said recovered code word and the 
corresponding Fourier transform samples of said regenerated second code word part, 

forming correlation samples for the second part of the recovered -code word by 
forming an inverse transform of said intermediate product samples, each of said 
correlation value samples providing the correlation value for the second part of said 
code words. 

15. A detecting data processor as claimed in any of Claims 10 to 14, 
wherein at least one of said first plurality of code word coefficients and said second 
plurality of code word coefficients forming said first and second parts of said -code 
word are combined with the material in accordance with a permutation code, wherein 
said decoding processor is operable to reverse the permutation of at least one of said 
first and said second recovered code word coefficients in accordance with said 
permutation code. 

16. A detecting data processor as claimed in any of Claims 10 to 14, 
wherein at least one of said first plurality of code word coefficients and said second 
plurality of code word coefficients forming said first and second parts of said code 
word are combined with the material in accordance with a permutation code, wherein 
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one of said detecting processor is operable to reverse the permutation of at least one of 
said first and said second re-gencrated code word coefficients in accordance with said 
permutation code. 

17. A system for identifying the recipient of a material item, said system 
comprising 

an encoding data processor according to any of Claims 1 to 7, operable to 
generate said marked material item by introducing a code word generated from a seed 
uniquely identifying said recipient, and 

a detecting data processor according to any of Claims 10 to 16, operable to 
detect with a predetermined false positive probability the recipient by detecting the 
presence of the code word in said material. 

18. A method of generating at least one marked version of an original item 
of material by introducing one of a predetermined set of code words into a copy of said 
original material item, said method comprising, 

forming said code word by generating a plurality of code word coefficients, 

and 

combining the code word coefficients with said material, wherein 
each of said plurality of code words of said set is uniquely associated with a 
data word having first and second fields, each of a set of values of said first field being 
represented as a first part of said code word having a first plurality of -coefficients, and 
said second field is represented as a second part of said code word having a. second 
plurality of coefficients. 

19. A method of identifying at least one of set of code words present in a 
marked version of a material item, said marked version having been formed by 
combining each of a plurality of samples of an original version of said material item 
with one of a corresponding plurality of code word coefficients, each code word being 
uniquely associated with a data word having first and second fields, each of a set of 
values of said first field being represented as a first part of said code word having a 
first plurality of coefficients, and said second field being represented as a second part 
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of said code word having a second plurality of coefficients, and each value of said first 
field being represented as a predetermined cyclic shift of said first plurality of code 
word coefficients of said first part of said code word, said method comprising 
generating a recovered code word from said marked material item, and 
detecting at least one first data field value and at least one second date field 
value by 

correlating the first part of the recovered code word with a first part of each 
regenerated code word from the set of code words to generate a correlation value for 
each regenerated code word, 

detecting the value of the first field value from a corresponding correlation 
value exceeding a predetermined threshold, 

correlating the second part of the recovered code word with a second part of 
each regenerated code word from the set of code words to generate a second 
correlation value for each regenerated code word, and 

detecting the value of the second field value from a corresponding second 
correlation value exceeding a predetermined threshold. 

20. A data signal representing a material item to which a code word has 
been added by the data processing apparatus according to any of Claims 1 to 7. 

21. A data carrier having recorded thereon a data signal according to Claim 

20. 

22. A computer program providing computer executable instructions, 
which when loaded onto a data processor configures the data processor to operate as 
the encoding data processing apparatus according to any of Claims 1 to 7 or the 
detecting data processor according to any of Claims 1 0 to 1 6. 

23. A computer program providing computer executable instructions, 
which when loaded on to a data processor causes the data processor to perform the 
method according to Claim 18 or 19. 
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24. A computer program product having a computer readable medium 
having recorded thereon information signals representative of the computer, program 
claimed in any of Claims 22 or 23. 

25. A receiver operable to receive signals representative of material items, 
comprising 

an encoding data processing apparatus according to any of Claims 1 to 7, 
operable to combine at least one code word with the received signals, said code word 
being provided to identify uniquely said received signals. 

26. A detecting or an encoding data processing apparatus as herein before 
described with reference to the accompanying drawings. 

27. A method of identifying at least one of a predetermined set of code 
words or a method of generating at least one marked copy of an original item of 
material as herein before described with reference to the accompanying drawings. 
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3 Detailed Description of Invention 
Field of Invention 

The present invention relates to encoding data processing apparatus and 
methods, which are arranged to embed code words into versions of material items. In 
some applications the code words are used to uniquely identify the material items. 

Correspondingly, the present invention also relates to data processing apparatus 
and methods operable to detect one or more code words, which may be present in a 
material item. 

Background of the Invention 

A process in which information is embedded in material for the purpose of 
identifying the material is referred to as watermarking. 

Identification code words are applied to versions of material items for the 
purpose of identifying the version of the material item. Watermarking can provide, 
therefore, a facility for identifying a recipient of a particular version of the material. 
As such, if the material is copied or used in a way, which is inconsistent with the 
wishes of the distributor of the material, the distributor can identify the material 
version from the identification code word and take appropriate action. 

In this description, an item of material, which is copied or used in a way, which 
is inconsistent with the wishes of the originator, owner, creator or distributor of the 
material, will be referred to for convenience as an offending item of material or 
offending material. 

The material could be any of video, audio, audio/video material, software 
programs, digital documents or any type of information bearing material. 

For a watermarking scheme to be successful, it should be as difficult as 
possible for the users to collude in order to mask or remove the identification code 
words. It should also be as difficult as possible for users to collude to alter the 
identification code word to the effect that one of the other users is falsely indicated as 
the perpetrator of an offending item of material. Such an attempt by users to collude to 
either mask the code word or alter the code word to indicate another user is known as a 
collusion attack. 
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Any watermarking scheme should be arranged to make it difficult for users 
receiving copies of the same material to launch a successful collusion attack. A 
watermarking scheme should therefore with high probability identify a marked 
material item, which has been the subject of a collusion attack. This is achieved by 
identifying a code word recovered from the offending material. Conversely, there 
should be a low probability of not detecting a code word when a code word is present 
(false negative probability). In addition the probability of falsely detecting a user as 
guilty of taking part in a collusion attack, when this user has not taken part, should be 
as low as possible (false positive probability). 

US Patent Serial No. 5, 664, 018 discloses a watermarking process in which a 
plurality of copies of material items are marked with a digital watermark formed from 
a code word having a predetermined number of coefficients. The watermarked 
material item is for example an image. The apparatus for introducing the watermark 
transforms the image into the Discrete Cosine Transform (DCT) domain. The digital 
watermark is formed from a set of randomly distributed coefficients having a normal 
distribution. In the DCT domain each code word coefficient is added to a 
corresponding one of the DCT coefficients. The watermarked image is formed by 
performing an inverse DCT. A related publication entitled "Resistance of Digital 
Watermarks to Collusion Attacks", by J. Kilian, F. T. Leighton et al, published by 
MIT, July 27, 1998, provides a detailed mathematical analysis of this watermarking 
process to prove its resistance to attack. 
Summary of the Invention 

According to an aspect of the present invention there is provided an encoding 
data processing apparatus for generating at least one marked copy of an original item 
of material by introducing one of a predetermined set of code words into a copy of the 
material item. The apparatus comprises a code word generator operable to provide the 
code word having a plurality of code word coefficients, and an encoding processor 
operable to combine the code word coefficients with the material. Each of the 
plurality of code words of the set is uniquely associated with a data word having first 
and second fields. Each of a set of values of the first field is represented as a first part 
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of the code word having a first plurality of coefficients, and the second field is 
represented as a second part of the code word having a second plurality of coefficients. 

The present invention provides a facility for generating watermark code words 
having a hierarchy of values. By providing watermark code words with first and 
second parts, a data word with first and second fields can be uniquely identified. The 
first and second fields can be assigned to different associated parameters such as for 
example address parameters. The first field could therefore identify the country of 
distribution of the material, whereas the second field could identify a particular 
distribution outlet within the country. 

In preferred embodiments each value of the first field is represented as a 
predetermined cyclic shift of the first plurality of code word coefficients forming the 
first part of the code word. In order to implement a practically useful system the 
number of uniquely identifiable code words in the set should be as high as possible. 
For a consumer distributed product such as a video or a film for display at a cinema, 
there should be in the order of a million or preferably tens of millions of code words in 
the set As such, it will be appreciated that correlating each of the regenerated code 
words and the recovered code word to identify the recovered code word and therefore 
the first and second fields, represents a considerable computational task. Embodiments 
of the present invention are provided with an advantage with respect to calculating the 
coirelation values for at least the first part of the code words in the set. This is 
provided by forming at least the first part of the code words of the set by generating a 
first plurality of code word coefficients and generating other code words by cyclically 
shifting the first plurality of code word coefficients. As such, the correlation values 
for all first parts of the code words of the set can be calculated using a Fourier 
transform correlator. As will be explained, the Fourier transform correlator provides 
the correlation values for the set in one operation, substantially reducing the 
computational task. 

The second plurality of coefficients of the second part of the code word may be 
derived from pseudo-random numbers generated by a pseudo-random number 
generator using one of a plurality of supplementary seeds. The supplementary seed for 
generating the second part of the code word may be identified by the value of the first 
field or correspondingly the relative shift of the first plurality of coefficients. Each of 
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the values of the second data field is represented as a corresponding shift of the second 
plurality of coefficients. By forming the watermark from first and second parts, a 
hierarchy of data words can be defined. Furthermore, the code words, which are 
defined by each data word, are provided with improved robustness to a collusion 
attack and can be efficiently detected using a Fourier transform correlator. 

In preferred embodiments, the encoding processor is operable to permute the 
order in which at least one of the first and second code word coefficients are combined 
with the material in accordance with a permutation code. Correspondingly, in 
preferred embodiments the detecting data processor is arranged to reverse the 
permutation of either the re-generated first and/or second code word coefficients or the 
recovered first and/or second code word coefficients in order to perform the 
correlation values. Permuting the code word coefficients provides an advantage of 
reducing the likelihood of a successful collusion attack, which may increase by 
forming the code words from cyclically shifting the first code word- 
According to an aspect of the present invention there is provided a detecting 
data processing apparatus as defined in the appended claims. As will be explained, 
example embodiments of the invention are arranged to identify the first and second 
field values from the first and second parts of the watermark. Advantageously, this is 
achieved by forming a correlation of the first plurality of coefficients from a recovered 
version of the code word with respect to the first part of each of the code words of the 
set. This correlation is achieved using a Fourier transform correlator. The first field 
value is determined by a correlation value produced by the Fourier transform 
correlator which indicates the shift of the first plurality of code word coefficients. The 
first field then identifies a supplementary seed from which the second plurality of -code 
word coefficients, forming the second part of the watermark, were generated. By 
again using a Fourier transform correlator, the value of the second field can be 
identified from correlation values indicating the shift of the second plurality of code 
word coefficients. 

Various further aspects and features of the present invention are defined in the 
appended claims. 
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Description of Preferred Embodiments 
Watermarking System Overview 

An example embodiment of the present invention will now be described with 
reference to protecting video images. The number of users to which the video images 
are to be distributed determines the number of copies. To each copy an identification 
code word is added which identifies the copy assigned to one of the users. 

Video images are one example of material, which can be protected by 
embedding a digital code word. Other examples of material, which can be protected 
by embedding a code word, include software programs, digital documents, music, 
audio signals and any other information-bearing signal. 

An example of an encoding image processing apparatus, which is arranged to 
introduce an identification code word into a copy of an original image, is shown in 
Figure 1. An original image / is received from a source and stored in a frame store 1. 
This original image is to be reproduced as a plurality of water marked copies, each of 
which is marked with a uniquely identifiable code word. The original image is passed 
to a Discrete Cosine Transform (DCT) processor 2, which divides the image into 8 x 8 
pixel blocks and forms a DCT of each of the 8x8 pixel blocks. The DCT processor 2 
therefore forms a DCT transformed image V. 

In the following description the term "samples" will be used to refer to discrete 
samples from which an image (or indeed any other type of material) is comprised. The 
samples may be luminance samples of the image, which is otherwise, produce from the 
image pixels. Therefore, where appropriate the terms samples and pixels are inter- 
changeable. 

The DCT image V is fed to an encoding processor 4. The encoding processor 4 
also receives identification code words from an identification code word generator 8. 

The code word generator 8 is provided with a plurality of seeds, each seed 
being used to generate one of the corresponding code words. Each of the generated 
code words may be embedded in a copy of the original image to form a watermarked 
image. The code word generator 8 is provided with a pseudo random number 
generator. The pseudo random number generator produces the code word coefficients 
to form a particular code word. In preferred embodiments the coefficients of the*code 
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words are generated in accordance with a normal distribution. However, the 
coefficients of the code word are otherwise predetermined in accordance with the seed, 
which is used to initialise the random number generator. Thus for each code word 
there is a corresponding seed which is store in a data store 12. Therefore it will be 
understood that to generate the code word X, seedj is retrieved from memory 12 and 
used to initialise the random number generator within the code word generator 8. 

In the following description the DCT version of the original image is 
represented as V, where; 

K = {v,}={v„v 2 ,v 3 ,v„ .V,} 

and v f are the DCT coefficients of the image. In other embodiments the 
samples of the image v,- could represent samples of the image in the spatial domain or 

in an alternative domain. 

Each of the code words A? comprises a plurality of n code word coefficients, 

where; 

x' = {x;}=(x;.*u;,x;,. 

The number of code word coefficients n corresponds to the number or samples 
of the original image V. However, a different number of coefficients is possible, and 
will be set in dependence upon a particular application. 

A vector of code word coefficients-P forming the i-th code word is then passed 
via channel 14 to the encoder 4. The encoder 4 is arranged to form a watermarked 
image W> by adding the code word X* to the image V. Effectively, therefore, as 
represented in the equation below, each of the code word coefficients is added to a 
different one of the coefficients of the image to form the watermark image W. 

W' = V+X' 

W'=v t +*,',v 2 +x' lt v 3 +x i i ,v t v„+^ 

As shown in Figure 1 , the watermarked images W* are formed at the output of 
the image processing apparatus by an forming inverse DCT of the image produced at 
the output of the encoding processor 4 by the inverse DCT processor 1 8. 

Therefore as represented in Figure 1 at the output of the encoder 4 a set of the 
watermarked images can be produced. For a data word of up to 20-bits, one of 10 000 
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000 code words can be selected to generate 10 million watermarked W versions of the 
original image J. 

Although the code word provides the facility for uniquely identifying a marked 
copy W of the image /, in other embodiments the 20 bits can provide a facility for 
communicating data within the image. As will be appreciated therefore, the 20 bits 
used to select the identification code word can provide a 20 bit pay-load for 
communicating data within the image V. 

The encoding image processing apparatus which is arranged to produce the 
watermarked images shown in Figure 1 may be incorporated into a variety of products 
for different scenarios in which embodiments of the present invention find application. 
For example, the encoding image processing apparatus may be connected to a web site 
or web server from which the watermarked images may be downloaded. Before 
downloading a copy of the image, a unique code word is introduced into the 
downloaded image, which can be used to detect the recipient of the downloaded image 
at some later point in time. 

In another application the encoding image processor forms part of a digital 
cinema projector in which the identification code word is added during projection of 
the image at, for example, a cinema. Thus, the -code word is arranged to identify the 
projector and the cinema at which the images are being reproduced. Accordingly, the 
identification code word can be identified within a pirate copy produced from the 
images projected by the cinema projector in order to identify the projector and the 
cinema from which pirate copies were produced. Correspondingly, a watermaiked 
image may be reproduced as a photograph or printout in which a reproduction or -copy 
may be made and distributed. Generally therefore, the distribution of the watermarked 
images produced by the encoding image processing apparatus shown in Figure 1 is 
represented by a distribution cloud 1 9. 
Detecting Processor 

A detecting image processing apparatus which is arranged to detect one or 
more of the code words, which may be present in an offending marked image is shown 
in Figure 2. Generally, the image processor shown in Figure 2 operates to identify one 
or more of the code words, which may be present in an offending copy of the image. 
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The offending version of the watermarked image Wis received from a source 
and stored in a frame store 20. Also stored in the frame store 24 is the original version 
of the image /, since the detection process performed by the image processor requires 
the original version of the image. The offending watermarked image W and the 
original version of the image are then fed via connecting channels 26, 28 to a 
registration processor 30. 

As already explained, the offending version of the image W may have been 
produced by photographing or otherwise reproducing a part of the watermarked image 
#*. As such, in order to improve the likelihood of detecting the identification code 
word, the registration processor 30 is arranged to substantially align the offending 
image with the original version of the image present in the data stores 20 and -24. The 
purpose of this alignment is to provide a correspondence between the original image 
samples / and the coiTesponding samples of the watermarked image W to which the 
code word coefficients have been added. 

The effects of the registration are illustrated in Figure 3- In Figure 3 an 
example of the original image / is shown with respect to an offending marked version 
of the image W. As illustrated in Figure 3, the watermarked image W is offset with 
respect to the original image J and this may be due to the relative aspect view of the 
camera from which the offending version of the watermarked image was produced. 

In order to recover a representation of the code word coefficients, the coirect 
samples of the original image should be subtracted from the corresponding samples of 
the marked offending image. To this end, the two images are aligned. As shown m 
Figure 3, the registered image »"'has a peripheral area PA which includes parts which 
were not present in the original image. 

As will be appreciated in other embodiments, the registration processor 30 may 
not be used because the offending image W may be already substantially aligned to 
the originally version of the image /, such as, for example, if the offending version was 
downloaded via the Internet. Accordingly, the detecting image processor is provided 
with an alternative channel 32, which communicates the marked image directly to the 
recovery processor 40. 
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The registered image Wis received by a recovery processor 40. The recovery 
processor 40 also receives a copy of the original image / via a second channel 44. The 
registered image W" and the original image / are transformed by a DCT transform 
processor 46 into the DCT domain. An estimated code word X' is then formed by 
subtracting the samples of the DCT domain marked image K'from the DCT domain 
samples of the original image V as expressed by the following equations: 

X'= V- V 

" vj-vj.vj-vj.^-vj.v;-^ v;-v B , 

= x' it x' 2 ,x 3 ,x it j£ 

The output of the recovery processor 40 therefore provides on a connecting 
channel 50 an estimate of the coefficients of the code word which is to be identified. 
The recovered code word X' is then fed to a first input of a correlator 52. The 
correlator 52 also receives on a second input the regenerated code words A* produced 
by the code word generator 54. The code word generator 54 operates in the same way 
as the code word generator 8 which produces all possible code words of the set, using 
the predetermined seeds which identify uniquely the code words from a store 58. 

The correlator 52 forms n similarity sim(i) values. In one embodiment, the 
similarity value is produced by forming a correlation in accordance with following 
equation: 

x'x' +*„'-x: 

Each of the n similarity values sim(f) is then fed to a detector «0. The detector 
60 then analyses the similarity values sim(0 produced for each of the n possible code 
words. As an example, the similarity values produced by the correlator 52 are shown 
in Figure 4 with respect to a threshold TH for each of the possible code words. As 
shown in Figure 4, two code words are above the threshold, 2001, 12345. As such, the 
detecting processor concludes that the watermarked version associated with code word 
2001 and code word 12345 must have colluded in order to form the offending image. 
Therefore, in accordance with a false positive detection probability, determined from 
the population size, which in this case is 10 million and the watermarking strength a , 
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the height of the threshold TH can be set in order to guarantee the false detection 
probability. As in the example in Figure 4, if the similarity values produced by the 
correlator 52 exceed the threshold then, with this false positive probability, the 
recipients of the marked image are considered to have colluded to form the offending 

watermarked version of the image W 1 . 

The following sections illustrate advantages and features of the operation of the 
watermarking system illustrated in Figures 1 and 2. 
Registration 

The process of aligning the offending marked version of the image with the 
copy of the original image comprises correlating the samples of the original image 
with respect to the marked image. The correlation is performed for different shifts of 
the respective samples of the images. This is illustrated in Figure 5. 

Figure 5A provides an illustration of discrete samples of the original image 7. 
whereas Figure 5B provides an illustration of discrete samples of the offending 
watermarked image W. As illustrated in the Figures 5A and 5B, the sampling rate 
provides a temporal difference between samples of dt. A result of shifting each of the 
sets of samples from the images and correlating the discrete samples is illustrated in 
Figure 5C. 

As shown in Figure 5C, for a shift of between 6 and 7 samples, the correlation 
peak is highest. The offending watermarked image is therefore shifted by this amount 
with respect to the original image to perform registration. 
. fourier Decoding 

As explained, with reference to Figures 1 and 2, the watermarking system can 
provide a facility for generating 10 million watermarked versions of an original image. 
This is effected using a 20-bit watermark value. However, as explained, in order to 
detect the presence of one of the code words in an offending watermarked image, the 
detecting image processor must correlate each of the possible code words in the set of 
10 million code words with respect to a recovered code word from the image. As will 
be appreciated, this represents a considerable computational task. 
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A correlator embodying the present invention provides a significant advantage 
in reducing the computational effort and therefore the time taken to detect the presence 
of a code word in an offending watermarked image. A correlator in accordance with 
the embodiment of the present invention is illustrated in Figure 6. The correlator 
shown in Figure 6 takes advantage of an alternative technique for calculating ihe 
correlation sum shown above. In accordance with this technique the correlation sum is 
calculated in accordance with the following equation: 

F'^FiX^FiX^)'}, where F(A) is the Fourier transform of A and F~\A) is 

the inverse Fourier transform of A. 

The correlator 52 shown in Figure 7 therefore comprises a first Fourier 
transform processor 100, and a second Fourier transform processor 102. Fourier 
transform processors 100, 102 may be implemented using Fast Fourier transform 
algorithms. The second Fourier transform processor 102 also forms the complex 
conjugate of the Fourier transform of the regenerated code word X 1 . The Fourier 
transform of the recovered code word X' and the complex conjugate of the Fourier 
transform of the regenerated code word X> are fed to first and seconds inputs of a 
multiplier 1 10. The multiplier 1 10 multiplies the respective samples from each of the 
Fourier transform processors 100, 102 and feeds the multiplied samples to an inverse 
Fourier transform processor 112. At the output of the correlator an inverse Fourier 
transform of the multiplied signals samples is formed. 

As will be appreciated, the implementation of the -correlator 52 shown in Figure 
6 provides an advantage in terms of time taken to compute the correlation for the n 
sample values of the regenerated code word X and the recovered code word X'. This 
is because the Fourier processors 100, 102, 112 can be formed from FFT integrated 
circuits such as, for example, are available as ASICS. Furthermore, the inverse Fourier 
transform provided at the output of the correlator 52 provides n similarity values sim(i) 
corresponding to n correlation sums. However, in order to utilise the properties of the 
correlator 52, shown in Figure 6 the code words are arranged to be generated by 
cyclically shifting one code word generated X( ] ) using a particular seed for the random 
number generator. This is illustrated below. As shown below, the first code word X {,) 
is represented as values jc, to x n which corresponds to the pseudo randomly produced 
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numbers from the code word generator 8. However, the second code word X (2) is 
produced by performing a cyclic shift on the first code word X°K Correspondingly, 
each of the other code words are produced by correspondingly cyclically shifting 
further the code word X 0) until the w-th code word is a code word shifted by w-1 
positions. 

X il) -Kx,,x 2 ,x 3 ,x 4 ... »Vl' X n) 

jr< 2 >->(x 2 ,x 3f x 4 x„-i>x»>*i) 

X 0) ~+(X 3 ,X 4 yX n , l9 X n9 X l9 X 2 ) 

X™ -» (X,,,X| 5 *2> X 3> X 4> *„-2.*«-l) 

By using this set of code words to form part of, or the whole of, the set of code 
words produced by the encoding image processor, the Fourier transform correlator 52 
can be used to generate in one operation all similarity values for all of the n code 
words. Therefore, as illustrated above, the corresponding shift of 1 to n of the original 
code word provides the n similarity values simfi), and as illustrated in Figure 4, for at 
least one of the code words, a large similarity value sim(i) is produced. Therefore, as 
will be appreciated the correlator 52 only receives one regenerated code word 
corresponding to first code word X°ho form the similarity values for the set of n code 
words as illustrated in Figure 4. 

As will be appreciated from the above explanation, if the code word contains N 
samples, then only N unique cyclic shifts are possible. Therefore, if the required 
population of code words is p, which is greater than N, then several base watermarks 
will be required. Each base watermark can be cyclically shifted to produce N unique 
code words. 

If the watermarked image forms one of a plurality of images in, -for example, a 
video sequence, then the same code word will be added to each of the images. As 
such, once the suspected code word has been identified using the Fourier transform 
correlator illustrated in Figure 6 3 then a subsequent correlation can be formed using the 
full correlation sum simfi) as explained above. However, because the suspected code 
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word has already been identified, then the correlation only needs to be performed once 
for the code word identified by the Fourier transform correlator shown in Figure 6. 

As will be appreciated, instead of forming the conjugate of the Fourier 
transform of the regenerated first code word X\ the conjugate of the Fourier 
transform of the recovered code word could be formed. This is expressed by the 
second alternative of the Fourier transform correlator shown below: 

Accordingly the conjugate of one of the Fourier transform of the recovered 
code word and the Fourier transform of the regenerated code word is formed by the 
Fourier transform processors 100, 102. 
Secret Permutation of Code Words 

One disadvantage of forming a code word from a cyclic shift of a first code 
word X l is that the security of the watermark may be compromised. This is because 
under a collusion attack two watermarked images are compared. If the same code 
word has been added to each image, with only a cyclic shift with respect to two 
versions of the same code word, an attacker may be more likely to identify the 
differences between the two marked material items and therefore identify the code 
word. With knowledge of the code word an attacker may either remove the watermark 
or alter the watermark to falsely implicate another. 

In order to reduce the likelihood of a successful collusion attack, the order of 
each of the code word coefficients of each of the cyclically shifted code words is 
randomly permuted in accordance with a secret permutation code tc. The permutation 
of the code word coefficients remains secret from the recipients of the marked images. 
Accordingly the likelihood of a successful collusion attack is reduced by an increase in 
the difficulty presented to a collusion attacker of identifying a correlation between two 
marked images. 

At the detecting data processor the secret permutation code n will be known. 
In the detecting data processor, either the code word re-generator or the recovery 
processor 40 is operable to reverse the permutation 7T* of either the re-generated code 
word coefficients or the recovered code word coefficients in order to perform the 
correlation. The operation of the encoding data processor of Figure 1 and the detecting 
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data processor of Figure 2 is therefore as presented in a flow diagrams in Figures 7 and 
8 respectively. 

Watermark Code Word Generation 

An improved implementation of watermark code word generation in 
accordance with an embodiment of the present invention will now be described with 
reference to Figures 9 and 10. As already explained, one of the advantages of 
generating code words by cyclically shifting a code word is that the Fourier transform 
correlator can be used to perform an efficient detector for the presence of a watermark 
code word in a marked material item. 

As explained above, one disadvantage of generating code words from 
cyclically shilling a first code word X } is an increased vulnerability to collusion attack. 
As explained above, this vulnerability can be reduced by permuting the code word 
coefficients in accordance with a secret permutation code. 

In order to reduce further the likelihood of a successful collusion attack, the 
code word generator performing part of the encoding image processor in preferred 
embodiments generates watermark code words having a plurality of differently 
generated parts. As will be explained, providing code words with a plurality of parts 
also provides a facility for generating a hierarchy of watermarks. As an illustration, a 
20-bit code word is considered. The 20-bit code word provides over one million 
(1048576) possible data values. 

In an illustrative embodiment the 20-bit code word is split into two 10-bit parts. 
This is shown in Figure 9. The first 10-bits aTe used to generate a first part of the 
watermark WM1. The second 10-bits are used to generate a second part of the 
watermark WM2. WM1 and WM2 are then embedded in the image to be watermarked 
as already explained. 

In preferred embodiments WM1 may be formed by generating a single code 
word comprising first code word coefficients produced by the pseudo random number 
generator forming part of the code word generator 8. These numbers arc generated 
from a base seed SEED basc as illustrated in Figure 9. The base seed may be generated 
from samples of the source image. 
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For the first 10-bits of WMl each of the 1024 possible data values are 
represented by 1024 possible shifts of the first part of the code word WMl -generated 
from the base seed. As illustrated in Figure 9 the shifts comprise 0 to 1023 possible 
values. 

The second part of the watermark WM2 is generated in dependence upon the 
first part of the watermark WML The shift applied to WMl is mapped onto one of 
1024 possible supplementary seeds. Therefore the Mh shift of the code word 
X 1 -> i = X) identifies a unique supplementary seed <seed 2 ). From the supplementary 
seed a further code word is generated labelled in Figure 9 as X 1 . Thus there is a 
unique pre-deteimined relationship between the shift of the first code word X? 
forming WMl and the seed used to form the second code word X? for WM2. 
However, in order to represent the further 1024 possible values, the second watermark 
WM2 is shifted in accordance with the 10-bit value for WM2. As shown in Figure 10, 
this provides a hierarchy of values. The first 1024 values provided by WMl provides 
an indication of the code word forming WM2. The possible shifts of the code word 
formed from WM2 then provides a second set of 1 024 values for a hierarchy of level 
two. 

Embodiments of the present invention provide a facility for identifying 
watermarked images on the basis of plurality of hierarchies. For example, the WMl 
can be used to identify the country, state or part of the state in which the images are 
distributed. The second level of the hierarchy can be used to identify a second part of 
the state, for example a town or cinema at which the watermarked images are 
reproduced. It will be appreciated that this can provide a facility for more quickly and 
more accurately identifying the location where the watermarked images were 
reproduced and from which offending copies were made. 

A further advantage of generating code words having two parts WMl , WM2, is 
that the Fourier transform decoder shown in Figure 6 can be used to efficiently identify 
which of the 1024 values are present in each of the two hierarchical levels. In 
combination, since the second part of the watermark WM2 is formed from 1024 
possible shifts of the second code word a further Fourier transform decoding can then 
be used to identify the possible shift of the second part of the code word WM2. 
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Forming the watermark code words having two related parts also provides an 
improvement in reducing the likelihood of a successful -collusion attack. As-explained 
above either or both code word parts may be permuted before being-combined with the 
image. 

Other Applications 

In addition to the above-mentioned applications of the encoding data 
processing apparatus of the watermarking system to a cinema projector and to a web 
server, other applications are envisaged. For example, a receiver/decoder is envisaged 
in which received signals are watermarked by introducing code words upon receipt of 
the signals from a communicating device. For example, a set top box is typically 
arranged to receive television and video signals from a "head-end" broadcast or multi- 
cast device. As will be appreciated in this application, the encoding data processing 
apparatus forms part of the set top box and is arranged to introduce watermark code 
words into the video signals as the signals are received and decoded. In one example 
embodiment, the watermark code word is arranged to uniquely identify the set top box 
which receives and decodes the video signals. 

In a further embodiment a digital cinema receiver is arranged to receive a 
digital cinema film via a satellite. The receiver is arranged to receive signals 
representing the digital cinema film and to decode the signals for reproduction. The 
receiver includes an encoding data processing apparatus, which introduces a 
watermark code word into the decoded film signals. The watermark code word is 
provided, for example, to uniquely identify the cinema receiving the film signals. 

A further example embodiment may comprise a digital camera or camcorder or 
the like which includes a memory and a memory controller. An encoding data 
processing apparatus according to an embodiment of the present invention is arranged 
to introduce a watermark code word stored in the memory into video signals captured 
by the camera. According to this embodiment, the encoding data processing apparatus 
does not include a code word generator because the code word is postered in the 
memory. Under the control of the memory controller the code word stored in the 
memory is embedded into the video signals, uniquely or quasi-uniquely identifying the 
video signals. 
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In a forther embodiment, an encoding data processing apparatus according to 
an embodiment of the invention is operable encoded a sequence of watermark code 
words into different frames of digital images forming a continuous or moving picture. 
The code words may be related to one another and may be used to identify -each of the 
images separately. 

Various further aspects and features of the present invention are defined in the 
appended claims. Various modifications can be made to the embodiments herein 
before described without departing from the scope of the present invention. 

4 Brief Description of Drawings 

Figure 1 is a schematic block diagram of an encoding image processing 
apparatus; 

Figure 2 is a schematic block diagram of a detecting image processing 
apparatus; 

Figure 3A is a representation of an original image, Figure 3B is a 
-representation of a marked image and Figure 3C is the marked image after registration; 

Figure 4 is a graphical representation of an example correlation result for each 
_of a set of code words N; 

Figure 5A is a graphical representation of samples of the original image /, 
Figure 5B is a graphical representation of samples of the watermarked image W; 
Figure 5C is a graphical representation of correlation results for the original image and 
the watermarked image with respect to discrete sample shifts; 

Figure 6 is a schematic block diagram of a correlator forming part of the 
detecting data processing apparatus shown in Figure 2; 

Figure 7 is a flow diagram of a process for forming watermarked images 
performed by the encoding image data processor; 

Figure 8 is a flow diagram of a process for identifying a watermark from a 
received marked copy of the image performed by the detecting data processor of 
Figure 2; 

Figure 9 is a schematic representation illustrating a process of forming code 
words having at least two parts; and 

Figure 1 0 is a schematic representation illustrating the use of the code word 
with two parts formed in Figure 9 to provide a hierarchical information. 
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1 Abstract 

A watermarking system comprises an encoding data processor operable to 
generate at least one marked version of an original item of material by introducing one 
of a predetermined set of code words into a copy of the original material item. The 
apparatus comprises a code word generator operable to provide the code word having a 
plurality of code word coefficients, and an encoding processor operable to combine the 
code word coefficients with the material. Each of the plurality of code words of the set 
is uniquely associated with a data word having first and second fields. Each of a set of 
values of the first field is represented as a first part of the code word having a first 
plurality of coefficients, and the second field is represented as a second part of the 
code word having a second plurality of coefficients. 

The present invention provides a facility for generating watermark code words 
having a hierarchy of values. By providing watermark code words having first and 
second parts, a data word with first and second fields can be uniquely identified. The 
first and second fields can be assigned to different associated parameters such as for 
example address parameters. The first field could therefore identity the country of 
distribution of the material, whereas the second field could identify a particular 
distribution outlet within the country. A watermarking system can be formed, which 
finds particular application in identifying a point of distribution of pirate copies of 
video material generated by capturing the watermarked image, using, for example, a 
camcorder in a cinema. 

2 Representative Drawing 

[Fig 7] 
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